Jul 26 16:53:47 user nova-compute[70594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 26 16:53:50 user nova-compute[70594]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70594) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 26 16:53:50 user nova-compute[70594]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70594) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 26 16:53:50 user nova-compute[70594]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70594) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 26 16:53:50 user nova-compute[70594]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 26 16:53:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:53:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:53:50 user nova-compute[70594]: INFO nova.virt.driver [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 26 16:53:51 user nova-compute[70594]: INFO nova.compute.provider_config [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Acquiring lock "singleton_lock" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Acquired lock "singleton_lock" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Releasing lock "singleton_lock" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Full set of CONF: {{(pid=70594) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ******************************************************************************** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Configuration options gathered from: {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ================================================================================ {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] allow_resize_to_same_host      = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] arq_binding_timeout            = 300 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] backdoor_port                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] backdoor_socket                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] block_device_allocate_retries  = 300 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] block_device_allocate_retries_interval = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cert                           = self.pem {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute_monitors               = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] config_dir                     = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] config_drive_format            = iso9660 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] config_source                  = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] console_host                   = user {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] control_exchange               = nova {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cpu_allocation_ratio           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] daemon                         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] debug                          = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] default_access_ip_network_name = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] default_availability_zone      = nova {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] default_ephemeral_format       = ext4 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] default_schedule_zone          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] disk_allocation_ratio          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] enable_new_services            = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] enabled_apis                   = ['osapi_compute'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] enabled_ssl_apis               = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] flat_injected                  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] force_config_drive             = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] force_raw_images               = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] graceful_shutdown_timeout      = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] heal_instance_info_cache_interval = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] host                           = user {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_build_timeout         = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_delete_interval       = 300 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_format                = [instance: %(uuid)s]  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_name_template         = instance-%08x {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_usage_audit           = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_usage_audit_period    = month {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] internal_service_availability_zone = internal {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] key                            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] live_migration_retry_count     = 30 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_config_append              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_dir                        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_file                       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_options                    = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_rotate_interval            = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_rotate_interval_type       = days {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] log_rotation_type              = none {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] long_rpc_timeout               = 1800 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] max_concurrent_builds          = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] max_concurrent_live_migrations = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] max_concurrent_snapshots       = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] max_local_block_devices        = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] max_logfile_count              = 30 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] max_logfile_size_mb            = 200 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] maximum_instance_delete_attempts = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metadata_listen                = 0.0.0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metadata_listen_port           = 8775 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metadata_workers               = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] migrate_max_retries            = -1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] mkisofs_cmd                    = genisoimage {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] my_ip                          = 10.0.0.210 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] network_allocate_retries       = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] osapi_compute_listen_port      = 8774 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] osapi_compute_unique_server_name_scope =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] osapi_compute_workers          = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] password_length                = 12 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] periodic_enable                = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] periodic_fuzzy_delay           = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] pointer_model                  = ps2mouse {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] preallocate_images             = none {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] publish_errors                 = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] pybasedir                      = /opt/stack/nova {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ram_allocation_ratio           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rate_limit_burst               = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rate_limit_except_level        = CRITICAL {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rate_limit_interval            = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reboot_timeout                 = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reclaim_instance_interval      = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] record                         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reimage_timeout_per_gb         = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] report_interval                = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rescue_timeout                 = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reserved_host_cpus             = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reserved_host_disk_mb          = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reserved_host_memory_mb        = 512 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] reserved_huge_pages            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] resize_confirm_window          = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] resize_fs_using_block_device   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] resume_guests_state_on_host_boot = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rpc_response_timeout           = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] run_external_periodic_tasks    = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] running_deleted_instance_action = reap {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] running_deleted_instance_poll_interval = 1800 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] running_deleted_instance_timeout = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler_instance_sync_interval = 120 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_down_time              = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] servicegroup_driver            = db {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] shelved_offload_time           = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] shelved_poll_interval          = 3600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] shutdown_timeout               = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] source_is_ipv6                 = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ssl_only                       = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] state_path                     = /opt/stack/data/nova {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] sync_power_state_interval      = 600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] sync_power_state_pool_size     = 1000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] syslog_log_facility            = LOG_USER {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] tempdir                        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] timeout_nbd                    = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] transport_url                  = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] update_resources_interval      = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_cow_images                 = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_eventlog                   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_journal                    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_json                       = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_rootwrap_daemon            = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_stderr                     = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] use_syslog                     = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vcpu_pin_set                   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plugging_is_fatal          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plugging_timeout           = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] virt_mkfs                      = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] volume_usage_poll_interval     = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] watch_log_file                 = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] web                            = /usr/share/spice-html5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_concurrency.disable_process_locking = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.auth_strategy              = keystone {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.compute_link_prefix        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.dhcp_domain                = novalocal {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.enable_instance_password   = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.glance_link_prefix         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.instance_list_per_project_cells = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.list_records_by_skipping_down_cells = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.local_metadata_per_cell    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.max_limit                  = 1000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.metadata_cache_expiration  = 15 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.neutron_default_tenant_id  = default {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.use_forwarded_for          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.use_neutron_default_nets   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_dynamic_targets = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_jsonfile_path   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.backend                  = dogpile.cache.memcached {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.backend_argument         = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.config_prefix            = cache.oslo {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.dead_timeout             = 60.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.debug_cache_backend      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.enable_retry_client      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.enable_socket_keepalive  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.enabled                  = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.expiration_time          = 600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.hashclient_retry_attempts = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_dead_retry      = 300 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_password        =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_pool_maxsize    = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_sasl_enabled    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.memcache_username        =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.proxies                  = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.retry_attempts           = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.retry_delay              = 0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.socket_keepalive_count   = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.socket_keepalive_idle    = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.socket_keepalive_interval = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.tls_allowed_ciphers      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.tls_cafile               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.tls_certfile             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.tls_enabled              = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cache.tls_keyfile              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.auth_section            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.auth_type               = password {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.cafile                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.certfile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.collect_timing          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.cross_az_attach         = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.debug                   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.endpoint_template       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.http_retries            = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.insecure                = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.keyfile                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.os_region_name          = RegionOne {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.split_loggers           = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cinder.timeout                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.cpu_dedicated_set      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.cpu_shared_set         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.image_type_exclude_list = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.max_concurrent_disk_ops = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.max_disk_devices_to_attach = -1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.resource_provider_association_refresh = 300 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.shutdown_retry_interval = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] conductor.workers              = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] console.allowed_origins        = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] console.ssl_ciphers            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] console.ssl_minimum_version    = default {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] consoleauth.token_ttl          = 600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.cafile                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.certfile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.collect_timing          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.connect_retries         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.connect_retry_delay     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.endpoint_override       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.insecure                = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.keyfile                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.max_version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.min_version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.region_name             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.service_name            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.service_type            = accelerator {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.split_loggers           = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.status_code_retries     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.timeout                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] cyborg.version                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.backend               = sqlalchemy {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.connection            = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.connection_debug      = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.connection_parameters =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.connection_recycle_time = 3600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.connection_trace      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.db_inc_retry_interval = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.db_max_retries        = 20 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.db_max_retry_interval = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.db_retry_interval     = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.max_overflow          = 50 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.max_pool_size         = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.max_retries           = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.mysql_enable_ndb      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.mysql_wsrep_sync_wait = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.pool_timeout          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.retry_interval        = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.slave_connection      = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] database.sqlite_synchronous    = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.backend           = sqlalchemy {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.connection        = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.connection_debug  = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.connection_parameters =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.connection_recycle_time = 3600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.connection_trace  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.db_inc_retry_interval = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.db_max_retries    = 20 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.db_max_retry_interval = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.db_retry_interval = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.max_overflow      = 50 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.max_pool_size     = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.max_retries       = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.mysql_enable_ndb  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.pool_timeout      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.retry_interval    = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.slave_connection  = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] api_database.sqlite_synchronous = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] devices.enabled_mdev_types     = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ephemeral_storage_encryption.enabled = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.api_servers             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.cafile                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.certfile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.collect_timing          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.connect_retries         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.connect_retry_delay     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.debug                   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.default_trusted_certificate_ids = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.enable_certificate_validation = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.enable_rbd_download     = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.endpoint_override       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.insecure                = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.keyfile                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.max_version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.min_version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.num_retries             = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.rbd_ceph_conf           =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.rbd_connect_timeout     = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.rbd_pool                =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.rbd_user                =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.region_name             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.service_name            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.service_type            = image {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.split_loggers           = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.status_code_retries     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.timeout                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.verify_glance_signatures = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] glance.version                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] guestfs.debug                  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.config_drive_cdrom      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.config_drive_inject_password = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.enable_instance_metrics_collection = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.enable_remotefx         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.instances_path_share    =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.iscsi_initiator_list    = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.limit_cpu_features      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.power_state_check_timeframe = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.use_multipath_io        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.volume_attach_retry_count = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.vswitch_name            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] mks.enabled                    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] image_cache.manager_interval   = 2400 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] image_cache.precache_concurrency = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] image_cache.remove_unused_base_images = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] image_cache.subdirectory_name  = _base {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.api_max_retries         = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.api_retry_interval      = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.auth_section            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.auth_type               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.cafile                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.certfile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.collect_timing          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.connect_retries         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.connect_retry_delay     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.endpoint_override       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.insecure                = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.keyfile                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.max_version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.min_version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.partition_key           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.peer_list               = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.region_name             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.serial_console_state_timeout = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.service_name            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.service_type            = baremetal {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.split_loggers           = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.status_code_retries     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.timeout                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ironic.version                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] key_manager.fixed_key          = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.barbican_api_version  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.barbican_endpoint     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.barbican_endpoint_type = public {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.barbican_region_name  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.cafile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.certfile              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.collect_timing        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.insecure              = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.keyfile               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.number_of_retries     = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.retry_delay           = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.send_service_user_token = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.split_loggers         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.timeout               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.verify_ssl            = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican.verify_ssl_path       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.auth_section = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.auth_type = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.cafile   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.certfile = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.collect_timing = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.insecure = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.keyfile  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.split_loggers = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] barbican_service_user.timeout  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.approle_role_id          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.approle_secret_id        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.cafile                   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.certfile                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.collect_timing           = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.insecure                 = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.keyfile                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.kv_mountpoint            = secret {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.kv_version               = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.namespace                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.root_token_id            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.split_loggers            = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.ssl_ca_crt_file          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.timeout                  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.use_ssl                  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.cafile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.certfile              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.collect_timing        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.connect_retries       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.connect_retry_delay   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.endpoint_override     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.insecure              = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.keyfile               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.max_version           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.min_version           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.region_name           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.service_name          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.service_type          = identity {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.split_loggers         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.status_code_retries   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.timeout               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] keystone.version               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.connection_uri         =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_mode               = custom {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: WARNING oslo_config.cfg [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_power_governor_high = performance {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_power_governor_low = powersave {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_power_management   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.device_detach_attempts = 8 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.device_detach_timeout  = 20 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.disk_cachemodes        = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.disk_prefix            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.enabled_perf_events    = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.file_backed_memory     = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.gid_maps               = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.hw_disk_discard        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.hw_machine_type        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_rbd_glance_store_name =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_rbd_pool        = rbd {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_type            = default {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.images_volume_group    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.inject_key             = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.inject_partition       = -2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.inject_password        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.iscsi_iface            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.iser_use_multipath     = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_bandwidth = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_downtime = 500 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_inbound_addr = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_permit_post_copy = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_scheme  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_timeout_action = abort {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_tunnelled = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: WARNING oslo_config.cfg [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 26 16:53:51 user nova-compute[70594]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 26 16:53:51 user nova-compute[70594]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 26 16:53:51 user nova-compute[70594]: and ``live_migration_inbound_addr`` respectively.
Jul 26 16:53:51 user nova-compute[70594]: ).  Its value may be silently ignored in the future.
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.live_migration_with_native_tls = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.max_queues             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.nfs_mount_options      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.num_memory_encrypted_guests = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.num_pcie_ports         = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.pmem_namespaces        = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.quobyte_client_cfg     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rbd_secret_uuid        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rbd_user               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.remote_filesystem_transport = ssh {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rescue_image_id        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rescue_kernel_id       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rescue_ramdisk_id      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.rx_queue_size          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.smbfs_mount_options    =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.snapshot_compression   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.snapshot_image_format  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.sparse_logical_volumes = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.swtpm_enabled          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.swtpm_group            = tss {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.swtpm_user             = tss {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.sysinfo_serial         = unique {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.tb_cache_size          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.tx_queue_size          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.uid_maps               = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.use_virtio_for_bridges = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.virt_type              = kvm {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.volume_clear           = zero {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.volume_clear_size      = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.volume_use_multipath   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_cache_path   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.vzstorage_mount_user   = stack {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.auth_section           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.auth_type              = password {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.cafile                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.certfile               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.collect_timing         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.connect_retries        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.connect_retry_delay    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.default_floating_pool  = public {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.endpoint_override      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.extension_sync_interval = 600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.http_retries           = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.insecure               = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.keyfile                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.max_version            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.min_version            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.ovs_bridge             = br-int {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.physnets               = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.region_name            = RegionOne {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.service_metadata_proxy = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.service_name           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.service_type           = network {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.split_loggers          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.status_code_retries    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.timeout                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] neutron.version                = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] notifications.bdms_in_notifications = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] notifications.default_level    = INFO {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] notifications.notification_format = unversioned {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] notifications.notify_on_state_change = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] pci.alias                      = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] pci.device_spec                = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] pci.report_in_placement        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.auth_section         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.auth_type            = password {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.cafile               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.certfile             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.collect_timing       = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.connect_retries      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.connect_retry_delay  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.default_domain_id    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.default_domain_name  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.domain_id            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.domain_name          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.endpoint_override    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.insecure             = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.keyfile              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.max_version          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.min_version          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.password             = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.project_domain_id    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.project_domain_name  = Default {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.project_id           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.project_name         = service {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.region_name          = RegionOne {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.service_name         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.service_type         = placement {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.split_loggers        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.status_code_retries  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.system_scope         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.timeout              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.trust_id             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.user_domain_id       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.user_domain_name     = Default {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.user_id              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.username             = placement {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] placement.version              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.cores                    = 20 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.count_usage_from_placement = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.injected_file_content_bytes = 10240 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.injected_file_path_length = 255 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.injected_files           = 5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.instances                = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.key_pairs                = 100 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.metadata_items           = 128 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.ram                      = 51200 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.recheck_quota            = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.server_group_members     = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] quota.server_groups            = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rdp.enabled                    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.image_metadata_prefilter = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.max_attempts         = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.max_placement_results = 1000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.query_placement_for_availability_zone = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.query_placement_for_image_type_support = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] scheduler.workers              = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.host_subset_size = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.isolated_hosts = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.isolated_images = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.pci_in_placement = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.track_instance_changes = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metrics.required               = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metrics.weight_multiplier      = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] metrics.weight_setting         = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] serial_console.enabled         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] serial_console.port_range      = 10000:20000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] serial_console.serialproxy_port = 6083 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.auth_section      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.auth_type         = password {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.cafile            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.certfile          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.collect_timing    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.insecure          = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.keyfile           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.send_service_user_token = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.split_loggers     = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] service_user.timeout           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.agent_enabled            = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.enabled                  = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.html5proxy_port          = 6082 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.image_compression        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.jpeg_compression         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.playback_compression     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.server_listen            = 127.0.0.1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.streaming_mode           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] spice.zlib_compression         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] upgrade_levels.baseapi         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] upgrade_levels.cert            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] upgrade_levels.compute         = auto {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] upgrade_levels.conductor       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] upgrade_levels.scheduler       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.auth_section = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.auth_type = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.cafile = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.certfile = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.insecure = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.keyfile = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vendordata_dynamic_auth.timeout = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.api_retry_count         = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.ca_file                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.cache_prefix            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.cluster_name            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.connection_pool_size    = 10 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.console_delay_seconds   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.datastore_regex         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.host_ip                 = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.host_password           = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.host_port               = 443 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.host_username           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.insecure                = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.integration_bridge      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.maximum_objects         = 100 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.pbm_default_policy      = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.pbm_enabled             = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.pbm_wsdl_location       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.serial_port_proxy_uri   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.serial_port_service_uri = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.task_poll_interval      = 0.5 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.use_linked_clone        = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.vnc_keymap              = en-us {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.vnc_port                = 5900 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vmware.vnc_port_total          = 10000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.auth_schemes               = ['none'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.enabled                    = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.novncproxy_port            = 6080 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.server_listen              = 0.0.0.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.vencrypt_ca_certs          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.vencrypt_client_cert       = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vnc.vencrypt_client_key        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.disable_rootwrap   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.enable_numa_live_migration = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.libvirt_disable_apic = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.client_socket_timeout     = 900 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.default_pool_size         = 1000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.keep_alive                = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.max_header_line           = 16384 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.ssl_ca_file               = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.ssl_cert_file             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.ssl_key_file              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.tcp_keepidle              = 600 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] zvm.ca_file                    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] zvm.cloud_connector_url        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] zvm.reachable_timeout          = 300 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.enforce_new_defaults = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.enforce_scope      = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.policy_default_rule = default {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.policy_file        = policy.yaml {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.connection_string     = messaging:// {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.enabled               = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.es_doc_type           = notification {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.es_scroll_size        = 10000 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.es_scroll_time        = 2m {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.filter_error_trace    = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.hmac_keys             = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.sentinel_service_name = mymaster {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.socket_timeout        = 0.1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.trace_requests        = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler.trace_sqlalchemy      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler_jaeger.process_tags   = {} {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler_jaeger.service_name_prefix = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] profiler_otlp.service_name_prefix = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] remote_debug.host              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] remote_debug.port              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.ssl      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_notifications.retry = -1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_messaging_notifications.transport_url = **** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.auth_section        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.auth_type           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.cafile              = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.certfile            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.collect_timing      = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.connect_retries     = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.connect_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.endpoint_id         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.endpoint_override   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.insecure            = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.keyfile             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.max_version         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.min_version         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.region_name         = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.service_name        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.service_type        = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.split_loggers       = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.status_code_retries = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.status_code_retry_delay = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.timeout             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.valid_interfaces    = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_limit.version             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_reports.file_event_handler = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] oslo_reports.log_dir           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_ovs_privileged.group  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] vif_plug_ovs_privileged.user   = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.flat_interface = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_ovs.isolate_vif         = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_vif_ovs.per_port_bridge     = False {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] os_brick.lock_path             = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] privsep_osbrick.capabilities   = [21] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] privsep_osbrick.group          = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] privsep_osbrick.helper_command = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] privsep_osbrick.user           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] nova_sys_admin.group           = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] nova_sys_admin.helper_command  = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] nova_sys_admin.user            = None {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG oslo_service.service [None req-bc668d2d-2523-4a94-81f9-ff84b04cfd5f None None] ******************************************************************************** {{(pid=70594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 26 16:53:51 user nova-compute[70594]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Starting native event thread {{(pid=70594) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Starting green dispatch thread {{(pid=70594) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Starting connection event dispatch thread {{(pid=70594) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Connecting to libvirt: qemu:///system {{(pid=70594) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f59199a36a0> {{(pid=70594) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f59199a36a0> {{(pid=70594) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 26 16:53:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Connection event '1' reason 'None'
Jul 26 16:53:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 26 16:53:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.mount [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Initialising _HostMountState generation 0 {{(pid=70594) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 26 16:53:58 user nova-compute[70594]: INFO nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host capabilities <capabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <host>
Jul 26 16:53:58 user nova-compute[70594]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 26 16:53:58 user nova-compute[70594]:     <cpu>
Jul 26 16:53:58 user nova-compute[70594]:       <arch>x86_64</arch>
Jul 26 16:53:58 user nova-compute[70594]:       <model>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <microcode version='1070'/>
Jul 26 16:53:58 user nova-compute[70594]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 26 16:53:58 user nova-compute[70594]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='ss'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='vmx'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='pcid'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='osxsave'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='hypervisor'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='arat'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='tsc_adjust'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='md-clear'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='arch-capabilities'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='invtsc'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='rsba'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature name='skip-l1dfl-vmentry'/>
Jul 26 16:53:58 user nova-compute[70594]:       <pages unit='KiB' size='4'/>
Jul 26 16:53:58 user nova-compute[70594]:       <pages unit='KiB' size='2048'/>
Jul 26 16:53:58 user nova-compute[70594]:     </cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <power_management>
Jul 26 16:53:58 user nova-compute[70594]:       <suspend_mem/>
Jul 26 16:53:58 user nova-compute[70594]:       <suspend_disk/>
Jul 26 16:53:58 user nova-compute[70594]:       <suspend_hybrid/>
Jul 26 16:53:58 user nova-compute[70594]:     </power_management>
Jul 26 16:53:58 user nova-compute[70594]:     <iommu support='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     <migration_features>
Jul 26 16:53:58 user nova-compute[70594]:       <live/>
Jul 26 16:53:58 user nova-compute[70594]:       <uri_transports>
Jul 26 16:53:58 user nova-compute[70594]:         <uri_transport>tcp</uri_transport>
Jul 26 16:53:58 user nova-compute[70594]:         <uri_transport>rdma</uri_transport>
Jul 26 16:53:58 user nova-compute[70594]:       </uri_transports>
Jul 26 16:53:58 user nova-compute[70594]:     </migration_features>
Jul 26 16:53:58 user nova-compute[70594]:     <topology>
Jul 26 16:53:58 user nova-compute[70594]:       <cells num='2'>
Jul 26 16:53:58 user nova-compute[70594]:         <cell id='0'>
Jul 26 16:53:58 user nova-compute[70594]:           <memory unit='KiB'>8189224</memory>
Jul 26 16:53:58 user nova-compute[70594]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 26 16:53:58 user nova-compute[70594]:           <pages unit='KiB' size='2048'>0</pages>
Jul 26 16:53:58 user nova-compute[70594]:           <distances>
Jul 26 16:53:58 user nova-compute[70594]:             <sibling id='0' value='10'/>
Jul 26 16:53:58 user nova-compute[70594]:             <sibling id='1' value='20'/>
Jul 26 16:53:58 user nova-compute[70594]:           </distances>
Jul 26 16:53:58 user nova-compute[70594]:           <cpus num='6'>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 26 16:53:58 user nova-compute[70594]:           </cpus>
Jul 26 16:53:58 user nova-compute[70594]:         </cell>
Jul 26 16:53:58 user nova-compute[70594]:         <cell id='1'>
Jul 26 16:53:58 user nova-compute[70594]:           <memory unit='KiB'>8206460</memory>
Jul 26 16:53:58 user nova-compute[70594]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 26 16:53:58 user nova-compute[70594]:           <pages unit='KiB' size='2048'>0</pages>
Jul 26 16:53:58 user nova-compute[70594]:           <distances>
Jul 26 16:53:58 user nova-compute[70594]:             <sibling id='0' value='20'/>
Jul 26 16:53:58 user nova-compute[70594]:             <sibling id='1' value='10'/>
Jul 26 16:53:58 user nova-compute[70594]:           </distances>
Jul 26 16:53:58 user nova-compute[70594]:           <cpus num='6'>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 26 16:53:58 user nova-compute[70594]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 26 16:53:58 user nova-compute[70594]:           </cpus>
Jul 26 16:53:58 user nova-compute[70594]:         </cell>
Jul 26 16:53:58 user nova-compute[70594]:       </cells>
Jul 26 16:53:58 user nova-compute[70594]:     </topology>
Jul 26 16:53:58 user nova-compute[70594]:     <cache>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 26 16:53:58 user nova-compute[70594]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 26 16:53:58 user nova-compute[70594]:     </cache>
Jul 26 16:53:58 user nova-compute[70594]:     <secmodel>
Jul 26 16:53:58 user nova-compute[70594]:       <model>apparmor</model>
Jul 26 16:53:58 user nova-compute[70594]:       <doi>0</doi>
Jul 26 16:53:58 user nova-compute[70594]:     </secmodel>
Jul 26 16:53:58 user nova-compute[70594]:     <secmodel>
Jul 26 16:53:58 user nova-compute[70594]:       <model>dac</model>
Jul 26 16:53:58 user nova-compute[70594]:       <doi>0</doi>
Jul 26 16:53:58 user nova-compute[70594]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 26 16:53:58 user nova-compute[70594]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 26 16:53:58 user nova-compute[70594]:     </secmodel>
Jul 26 16:53:58 user nova-compute[70594]:   </host>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='alpha'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>clipper</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='armv6l'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>integratorcp</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>borzoi</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>spitz</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>nuri</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>musca-b1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>versatileab</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>kzm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>musca-a</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>smdkc210</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sx1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>z2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>tosa</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>sabrelite</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>realview-eb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>n810</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>n800</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>versatilepb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>terrier</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mainstone</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>midway</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>musicpal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>microbit</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>cubieboard</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>verdex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>netduino2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>raspi2b</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>cheetah</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>highbank</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>akita</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>connex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>collie</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>raspi0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='armv7l'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>integratorcp</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>borzoi</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>spitz</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>nuri</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>musca-b1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>versatileab</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>kzm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>musca-a</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>smdkc210</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sx1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>z2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>tosa</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>sabrelite</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>realview-eb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>n810</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>n800</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>versatilepb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>terrier</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mainstone</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>midway</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>musicpal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>microbit</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>cubieboard</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>verdex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>netduino2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>raspi2b</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>cheetah</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>highbank</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>akita</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>connex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>collie</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>raspi0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='aarch64'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>integratorcp</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>borzoi</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>spitz</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>nuri</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>musca-b1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>versatileab</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>kzm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>musca-a</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>smdkc210</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sx1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>z2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>tosa</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>sabrelite</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>realview-eb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>n810</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>n800</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>versatilepb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>terrier</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mainstone</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>midway</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>musicpal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>microbit</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>cubieboard</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>verdex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>netduino2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>raspi3b</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>raspi2b</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>cheetah</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>highbank</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>akita</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>connex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>collie</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>raspi0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <acpi default='on' toggle='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='cris'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='i686'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>x-remote</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>isapc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>microvm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='kvm'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <pae/>
Jul 26 16:53:58 user nova-compute[70594]:       <nonpae/>
Jul 26 16:53:58 user nova-compute[70594]:       <acpi default='on' toggle='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:       <apic default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='m68k'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>an5206</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>q800</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>next-cube</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='microblaze'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='microblazeel'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='mips'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='16'>malta</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mipssim</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='mipsel'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='16'>malta</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mipssim</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='mips64'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='16'>malta</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mipssim</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>pica61</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>magnum</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='mips64el'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='16'>malta</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mipssim</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>pica61</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>magnum</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='16'>boston</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='ppc'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>g3beige</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mac99</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ppce500</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>pegasos2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sam460ex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>bamboo</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>40p</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>ref405ep</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>taihu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='ppc64'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2048'>powernv9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>taihu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2048'>powernv10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ppce500</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>40p</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>pegasos2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>bamboo</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>g3beige</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mac99</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sam460ex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>ref405ep</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2048'>powernv8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='ppc64le'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2048'>powernv9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>taihu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2048'>powernv10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ppce500</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>40p</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>pegasos2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>bamboo</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>g3beige</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>mac99</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sam460ex</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>ref405ep</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2048'>powernv8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='riscv32'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='8'>spike</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>opentitan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='5'>sifive_u</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sifive_e</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='8'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='riscv64'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='8'>spike</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='5'>sifive_u</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>shakti_c</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sifive_e</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='8'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='s390x'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='sh4'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>shix</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>r2d</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='sh4eb'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>shix</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>r2d</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='sparc'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>SS-5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>SS-20</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>LX</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>SS-4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>SS-10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>Voyager</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='sparc64'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sun4u</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>niagara</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>sun4v</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='x86_64'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>64</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>x-remote</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='1'>isapc</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>microvm</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='kvm'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <acpi default='on' toggle='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:       <apic default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='xtensa'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>sim</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>kc705</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ml605</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx200</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx60</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]:   <guest>
Jul 26 16:53:58 user nova-compute[70594]:     <os_type>hvm</os_type>
Jul 26 16:53:58 user nova-compute[70594]:     <arch name='xtensaeb'>
Jul 26 16:53:58 user nova-compute[70594]:       <wordsize>32</wordsize>
Jul 26 16:53:58 user nova-compute[70594]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='4'>sim</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>kc705</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ml605</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>virt</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx200</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>lx60</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 26 16:53:58 user nova-compute[70594]:       <domain type='qemu'/>
Jul 26 16:53:58 user nova-compute[70594]:     </arch>
Jul 26 16:53:58 user nova-compute[70594]:     <features>
Jul 26 16:53:58 user nova-compute[70594]:       <cpuselection/>
Jul 26 16:53:58 user nova-compute[70594]:       <deviceboot/>
Jul 26 16:53:58 user nova-compute[70594]:       <disksnapshot default='on' toggle='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     </features>
Jul 26 16:53:58 user nova-compute[70594]:   </guest>
Jul 26 16:53:58 user nova-compute[70594]: </capabilities>
Jul 26 16:53:58 user nova-compute[70594]: 
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 26 16:53:58 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <path>/usr/bin/qemu-system-i386</path>
Jul 26 16:53:58 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:58 user nova-compute[70594]:   <machine>pc-q35-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:   <arch>i686</arch>
Jul 26 16:53:58 user nova-compute[70594]:   <vcpu max='288'/>
Jul 26 16:53:58 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='firmware'/>
Jul 26 16:53:58 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </loader>
Jul 26 16:53:58 user nova-compute[70594]:   </os>
Jul 26 16:53:58 user nova-compute[70594]:   <cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='lm'/>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>kvm64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>core2duo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Penryn</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G1</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Conroe</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:   </cpu>
Jul 26 16:53:58 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:58 user nova-compute[70594]:   <devices>
Jul 26 16:53:58 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </disk>
Jul 26 16:53:58 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </graphics>
Jul 26 16:53:58 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </video>
Jul 26 16:53:58 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:58 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:58 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </rng>
Jul 26 16:53:58 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:58 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </tpm>
Jul 26 16:53:58 user nova-compute[70594]:   </devices>
Jul 26 16:53:58 user nova-compute[70594]:   <features>
Jul 26 16:53:58 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:   </features>
Jul 26 16:53:58 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 26 16:53:58 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <path>/usr/bin/qemu-system-i386</path>
Jul 26 16:53:58 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:58 user nova-compute[70594]:   <machine>pc-i440fx-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:   <arch>i686</arch>
Jul 26 16:53:58 user nova-compute[70594]:   <vcpu max='255'/>
Jul 26 16:53:58 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='firmware'/>
Jul 26 16:53:58 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </loader>
Jul 26 16:53:58 user nova-compute[70594]:   </os>
Jul 26 16:53:58 user nova-compute[70594]:   <cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='lm'/>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>kvm64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>core2duo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Penryn</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G1</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Conroe</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:   </cpu>
Jul 26 16:53:58 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:58 user nova-compute[70594]:   <devices>
Jul 26 16:53:58 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ide</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </disk>
Jul 26 16:53:58 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </graphics>
Jul 26 16:53:58 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </video>
Jul 26 16:53:58 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:58 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:58 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </rng>
Jul 26 16:53:58 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:58 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </tpm>
Jul 26 16:53:58 user nova-compute[70594]:   </devices>
Jul 26 16:53:58 user nova-compute[70594]:   <features>
Jul 26 16:53:58 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:   </features>
Jul 26 16:53:58 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 26 16:53:58 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <path>/usr/bin/qemu-system-i386</path>
Jul 26 16:53:58 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:58 user nova-compute[70594]:   <machine>pc-i440fx-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:   <arch>i686</arch>
Jul 26 16:53:58 user nova-compute[70594]:   <vcpu max='255'/>
Jul 26 16:53:58 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='firmware'/>
Jul 26 16:53:58 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </loader>
Jul 26 16:53:58 user nova-compute[70594]:   </os>
Jul 26 16:53:58 user nova-compute[70594]:   <cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='lm'/>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>kvm64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>core2duo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Penryn</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G1</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Conroe</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:   </cpu>
Jul 26 16:53:58 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:58 user nova-compute[70594]:   <devices>
Jul 26 16:53:58 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ide</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </disk>
Jul 26 16:53:58 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </graphics>
Jul 26 16:53:58 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </video>
Jul 26 16:53:58 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:58 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:58 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </rng>
Jul 26 16:53:58 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:58 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </tpm>
Jul 26 16:53:58 user nova-compute[70594]:   </devices>
Jul 26 16:53:58 user nova-compute[70594]:   <features>
Jul 26 16:53:58 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:   </features>
Jul 26 16:53:58 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 26 16:53:58 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <path>/usr/bin/qemu-system-i386</path>
Jul 26 16:53:58 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:58 user nova-compute[70594]:   <machine>pc-q35-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:   <arch>i686</arch>
Jul 26 16:53:58 user nova-compute[70594]:   <vcpu max='288'/>
Jul 26 16:53:58 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='firmware'/>
Jul 26 16:53:58 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </loader>
Jul 26 16:53:58 user nova-compute[70594]:   </os>
Jul 26 16:53:58 user nova-compute[70594]:   <cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='lm'/>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>kvm64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>core2duo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Westmere</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Penryn</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G1</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Nehalem</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Conroe</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:   </cpu>
Jul 26 16:53:58 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:58 user nova-compute[70594]:   <devices>
Jul 26 16:53:58 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </disk>
Jul 26 16:53:58 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </graphics>
Jul 26 16:53:58 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </video>
Jul 26 16:53:58 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:58 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:58 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </rng>
Jul 26 16:53:58 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:58 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </tpm>
Jul 26 16:53:58 user nova-compute[70594]:   </devices>
Jul 26 16:53:58 user nova-compute[70594]:   <features>
Jul 26 16:53:58 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:   </features>
Jul 26 16:53:58 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 26 16:53:58 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 26 16:53:58 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:58 user nova-compute[70594]:   <machine>pc-q35-jammy</machine>
Jul 26 16:53:58 user nova-compute[70594]:   <arch>x86_64</arch>
Jul 26 16:53:58 user nova-compute[70594]:   <vcpu max='288'/>
Jul 26 16:53:58 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='firmware'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>efi</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </loader>
Jul 26 16:53:58 user nova-compute[70594]:   </os>
Jul 26 16:53:58 user nova-compute[70594]:   <cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='invtsc'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='rsba'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='pschange-mc-no'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>kvm64</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>core2duo</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Westmere-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Westmere</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Penryn</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Opteron_G1</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Nehalem</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>Conroe</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:58 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:   </cpu>
Jul 26 16:53:58 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:58 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:58 user nova-compute[70594]:   <devices>
Jul 26 16:53:58 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </disk>
Jul 26 16:53:58 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </graphics>
Jul 26 16:53:58 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </video>
Jul 26 16:53:58 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:58 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:58 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </rng>
Jul 26 16:53:58 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:58 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </tpm>
Jul 26 16:53:58 user nova-compute[70594]:   </devices>
Jul 26 16:53:58 user nova-compute[70594]:   <features>
Jul 26 16:53:58 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:58 user nova-compute[70594]:   </features>
Jul 26 16:53:58 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 26 16:53:58 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:58 user nova-compute[70594]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 26 16:53:58 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:58 user nova-compute[70594]:   <machine>pc-i440fx-6.2</machine>
Jul 26 16:53:58 user nova-compute[70594]:   <arch>x86_64</arch>
Jul 26 16:53:58 user nova-compute[70594]:   <vcpu max='255'/>
Jul 26 16:53:58 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:58 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:     <enum name='firmware'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>efi</value>
Jul 26 16:53:58 user nova-compute[70594]:     </enum>
Jul 26 16:53:58 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </loader>
Jul 26 16:53:58 user nova-compute[70594]:   </os>
Jul 26 16:53:58 user nova-compute[70594]:   <cpu>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:58 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:58 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:58 user nova-compute[70594]:       </enum>
Jul 26 16:53:58 user nova-compute[70594]:     </mode>
Jul 26 16:53:58 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:58 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:58 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:58 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='invtsc'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='rsba'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='pschange-mc-no'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>kvm64</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>core2duo</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Westmere-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Westmere</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Penryn</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Opteron_G1</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Nehalem</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Conroe</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:   </cpu>
Jul 26 16:53:59 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:59 user nova-compute[70594]:     </enum>
Jul 26 16:53:59 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:59 user nova-compute[70594]:   <devices>
Jul 26 16:53:59 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>ide</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </disk>
Jul 26 16:53:59 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </graphics>
Jul 26 16:53:59 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </video>
Jul 26 16:53:59 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:59 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:59 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </rng>
Jul 26 16:53:59 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:59 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </tpm>
Jul 26 16:53:59 user nova-compute[70594]:   </devices>
Jul 26 16:53:59 user nova-compute[70594]:   <features>
Jul 26 16:53:59 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:59 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:59 user nova-compute[70594]:   </features>
Jul 26 16:53:59 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:59 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 26 16:53:59 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:59 user nova-compute[70594]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 26 16:53:59 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:59 user nova-compute[70594]:   <machine>pc-i440fx-jammy</machine>
Jul 26 16:53:59 user nova-compute[70594]:   <arch>x86_64</arch>
Jul 26 16:53:59 user nova-compute[70594]:   <vcpu max='255'/>
Jul 26 16:53:59 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:     <enum name='firmware'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>efi</value>
Jul 26 16:53:59 user nova-compute[70594]:     </enum>
Jul 26 16:53:59 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </loader>
Jul 26 16:53:59 user nova-compute[70594]:   </os>
Jul 26 16:53:59 user nova-compute[70594]:   <cpu>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='invtsc'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='rsba'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='pschange-mc-no'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>kvm64</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>core2duo</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Westmere-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Westmere</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Penryn</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Opteron_G1</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Nehalem</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Conroe</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:   </cpu>
Jul 26 16:53:59 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:59 user nova-compute[70594]:     </enum>
Jul 26 16:53:59 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:59 user nova-compute[70594]:   <devices>
Jul 26 16:53:59 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>ide</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </disk>
Jul 26 16:53:59 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </graphics>
Jul 26 16:53:59 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </video>
Jul 26 16:53:59 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:59 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:59 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </rng>
Jul 26 16:53:59 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:59 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </tpm>
Jul 26 16:53:59 user nova-compute[70594]:   </devices>
Jul 26 16:53:59 user nova-compute[70594]:   <features>
Jul 26 16:53:59 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:59 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:59 user nova-compute[70594]:   </features>
Jul 26 16:53:59 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:59 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 26 16:53:59 user nova-compute[70594]: <domainCapabilities>
Jul 26 16:53:59 user nova-compute[70594]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 26 16:53:59 user nova-compute[70594]:   <domain>kvm</domain>
Jul 26 16:53:59 user nova-compute[70594]:   <machine>pc-q35-6.2</machine>
Jul 26 16:53:59 user nova-compute[70594]:   <arch>x86_64</arch>
Jul 26 16:53:59 user nova-compute[70594]:   <vcpu max='288'/>
Jul 26 16:53:59 user nova-compute[70594]:   <iothreads supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:   <os supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:     <enum name='firmware'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>efi</value>
Jul 26 16:53:59 user nova-compute[70594]:     </enum>
Jul 26 16:53:59 user nova-compute[70594]:     <loader supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>rom</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>pflash</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='readonly'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='secure'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>yes</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>no</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </loader>
Jul 26 16:53:59 user nova-compute[70594]:   </os>
Jul 26 16:53:59 user nova-compute[70594]:   <cpu>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='host-passthrough' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='hostPassthroughMigratable'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='maximum' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='maximumMigratable'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>on</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>off</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='host-model' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <vendor>Intel</vendor>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ss'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='vmx'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='pcid'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='hypervisor'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='arat'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='tsc_adjust'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='umip'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='md-clear'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='stibp'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='arch-capabilities'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ssbd'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='invtsc'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ibpb'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='ibrs'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='amd-stibp'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='amd-ssbd'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='rsba'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='require' name='pschange-mc-no'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='disable' name='erms'/>
Jul 26 16:53:59 user nova-compute[70594]:       <feature policy='disable' name='xsaveopt'/>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:     <mode name='custom' supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>qemu64</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>qemu32</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>phenom</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium3</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium2</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>pentium</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>n270</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>kvm64</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>kvm32</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>coreduo</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>core2duo</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>athlon</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Westmere-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Westmere</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Snowridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Skylake-Client</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>SandyBridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Penryn</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G5</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G4</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G3</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Opteron_G2</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Opteron_G1</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Nehalem</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>IvyBridge</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Icelake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Haswell</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-Rome</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-Milan</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC-IBPB</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>EPYC</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Dhyana</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cooperlake</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>Conroe</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Cascadelake-Server</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-noTSX</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell-IBRS</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='no'>Broadwell</model>
Jul 26 16:53:59 user nova-compute[70594]:       <model usable='yes'>486</model>
Jul 26 16:53:59 user nova-compute[70594]:     </mode>
Jul 26 16:53:59 user nova-compute[70594]:   </cpu>
Jul 26 16:53:59 user nova-compute[70594]:   <memoryBacking supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:     <enum name='sourceType'>
Jul 26 16:53:59 user nova-compute[70594]:       <value>file</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>anonymous</value>
Jul 26 16:53:59 user nova-compute[70594]:       <value>memfd</value>
Jul 26 16:53:59 user nova-compute[70594]:     </enum>
Jul 26 16:53:59 user nova-compute[70594]:   </memoryBacking>
Jul 26 16:53:59 user nova-compute[70594]:   <devices>
Jul 26 16:53:59 user nova-compute[70594]:     <disk supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='diskDevice'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>disk</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>cdrom</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>floppy</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>lun</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='bus'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>fdc</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>sata</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </disk>
Jul 26 16:53:59 user nova-compute[70594]:     <graphics supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='type'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>sdl</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vnc</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>spice</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>egl-headless</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </graphics>
Jul 26 16:53:59 user nova-compute[70594]:     <video supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='modelType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vga</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>cirrus</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>vmvga</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>qxl</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>none</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>bochs</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>ramfb</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </video>
Jul 26 16:53:59 user nova-compute[70594]:     <hostdev supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='mode'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>subsystem</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='startupPolicy'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>default</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>mandatory</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>requisite</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>optional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='subsysType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>usb</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>pci</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>scsi</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='capsType'/>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='pciBackend'/>
Jul 26 16:53:59 user nova-compute[70594]:     </hostdev>
Jul 26 16:53:59 user nova-compute[70594]:     <rng supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtio-non-transitional</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>random</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>egd</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>builtin</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </rng>
Jul 26 16:53:59 user nova-compute[70594]:     <filesystem supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='driverType'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>path</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>handle</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>virtiofs</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </filesystem>
Jul 26 16:53:59 user nova-compute[70594]:     <tpm supported='yes'>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='model'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>tpm-tis</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>tpm-crb</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:       <enum name='backendModel'>
Jul 26 16:53:59 user nova-compute[70594]:         <value>passthrough</value>
Jul 26 16:53:59 user nova-compute[70594]:         <value>emulator</value>
Jul 26 16:53:59 user nova-compute[70594]:       </enum>
Jul 26 16:53:59 user nova-compute[70594]:     </tpm>
Jul 26 16:53:59 user nova-compute[70594]:   </devices>
Jul 26 16:53:59 user nova-compute[70594]:   <features>
Jul 26 16:53:59 user nova-compute[70594]:     <gic supported='no'/>
Jul 26 16:53:59 user nova-compute[70594]:     <vmcoreinfo supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <genid supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <backingStoreInput supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <backup supported='yes'/>
Jul 26 16:53:59 user nova-compute[70594]:     <sev supported='no'/>
Jul 26 16:53:59 user nova-compute[70594]:   </features>
Jul 26 16:53:59 user nova-compute[70594]: </domainCapabilities>
Jul 26 16:53:59 user nova-compute[70594]:  {{(pid=70594) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70594) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70594) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Checking secure boot support for host arch (x86_64) {{(pid=70594) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Secure Boot support detected
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] cpu compare xml: <cpu match="exact">
Jul 26 16:53:59 user nova-compute[70594]:   <model>Nehalem</model>
Jul 26 16:53:59 user nova-compute[70594]: </cpu>
Jul 26 16:53:59 user nova-compute[70594]:  {{(pid=70594) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.virt.node [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Generated node identity e707ce86-5823-47be-ae04-864d58aeb2e9
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.virt.node [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Wrote node identity e707ce86-5823-47be-ae04-864d58aeb2e9 to /opt/stack/data/nova/compute_id
Jul 26 16:53:59 user nova-compute[70594]: WARNING nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Compute nodes ['e707ce86-5823-47be-ae04-864d58aeb2e9'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 26 16:53:59 user nova-compute[70594]: WARNING nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 26 16:53:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:53:59 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:53:59 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Hypervisor/Node resource view: name=user free_ram=10923MB free_disk=26.383296966552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:53:59 user nova-compute[70594]: WARNING nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] No compute node record for user:e707ce86-5823-47be-ae04-864d58aeb2e9: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e707ce86-5823-47be-ae04-864d58aeb2e9 could not be found.
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Compute node record created for user:user with uuid: e707ce86-5823-47be-ae04-864d58aeb2e9
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [req-8a600294-1339-447c-90f7-de7861d25607] Created resource provider record via placement API for resource provider with UUID e707ce86-5823-47be-ae04-864d58aeb2e9 and name user.
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70594) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 26 16:53:59 user nova-compute[70594]: INFO nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] kernel doesn't support AMD SEV
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Libvirt baseline CPU <cpu>
Jul 26 16:53:59 user nova-compute[70594]:   <arch>x86_64</arch>
Jul 26 16:53:59 user nova-compute[70594]:   <model>Nehalem</model>
Jul 26 16:53:59 user nova-compute[70594]:   <vendor>Intel</vendor>
Jul 26 16:53:59 user nova-compute[70594]:   <topology sockets="6" cores="1" threads="1"/>
Jul 26 16:53:59 user nova-compute[70594]: </cpu>
Jul 26 16:53:59 user nova-compute[70594]:  {{(pid=70594) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Updated inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Updating resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 generation from 0 to 1 during operation: update_inventory {{(pid=70594) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 26 16:53:59 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 16:54:00 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Updating resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 generation from 1 to 2 during operation: update_traits {{(pid=70594) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 26 16:54:00 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 16:54:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:54:00 user nova-compute[70594]: DEBUG nova.service [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Creating RPC server for service compute {{(pid=70594) start /opt/stack/nova/nova/service.py:182}}
Jul 26 16:54:00 user nova-compute[70594]: DEBUG nova.service [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Join ServiceGroup membership for this service compute {{(pid=70594) start /opt/stack/nova/nova/service.py:199}}
Jul 26 16:54:00 user nova-compute[70594]: DEBUG nova.servicegroup.drivers.db [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70594) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:54:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:54:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=10301MB free_disk=26.287349700927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:54:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:55:52 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:55:53 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:55:53 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:55:53 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=10258MB free_disk=26.333885192871094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 16:55:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:56:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 16:56:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 16:56:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 16:56:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:56:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:56:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:56:53 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:56:54 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:56:54 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:56:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=10282MB free_disk=26.106426239013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 16:56:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:56:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:56:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 16:57:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 16:57:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 16:57:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 16:57:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:57:53 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:57:54 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:57:54 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:57:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=9544MB free_disk=26.137653350830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 16:57:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:57:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:57:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:05 user nova-compute[70594]: INFO nova.compute.claims [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Claim successful on node user
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:05 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Creating image(s)
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "/opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "/opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "/opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:06 user nova-compute[70594]: INFO nova.compute.claims [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Claim successful on node user
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.policy [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87ac9d550cb04cbd972aacae0a4af674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a12260d9e34ee2b6154a9f4f3281b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Creating image(s)
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "/opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "/opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "/opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG nova.policy [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0475b99e94644a248b5a8b934b881c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6ae07082de4f438c3cd0e80c27e39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.part --force-share --output=json" returned: 0 in 0.124s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG nova.virt.images [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] eb0188fe-f507-4fcc-b390-0fd03c1cea08 was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.part /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.part /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.converted" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.536s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:07 user nova-compute[70594]: INFO oslo.privsep.daemon [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy19ohbb7/privsep.sock']
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.752s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:07 user sudo[79961]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy19ohbb7/privsep.sock
Jul 26 16:58:07 user sudo[79961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 26 16:58:08 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Successfully created port: 09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:09 user nova-compute[70594]: INFO nova.compute.claims [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Claim successful on node user
Jul 26 16:58:09 user sudo[79961]: pam_unix(sudo:session): session closed for user root
Jul 26 16:58:09 user nova-compute[70594]: INFO oslo.privsep.daemon [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Spawned new privsep daemon via rootwrap
Jul 26 16:58:09 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 26 16:58:09 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 26 16:58:09 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 26 16:58:09 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79974
Jul 26 16:58:09 user nova-compute[70594]: WARNING oslo_privsep.priv_context [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] privsep daemon already running
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.194s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk 1073741824" returned: 0 in 0.044s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.157s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:09 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Creating image(s)
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Successfully created port: 19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk 1073741824" returned: 0 in 0.048s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Cannot resize image /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lazy-loading 'migration_context' on Instance uuid d51f1e40-acab-40c5-814d-ca5022cf04c7 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Ensure instance console log exists: /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.176s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk 1073741824" returned: 0 in 0.053s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Cannot resize image /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lazy-loading 'migration_context' on Instance uuid e28e16e1-92fb-48c9-9763-249ae2f1d906 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Ensure instance console log exists: /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.policy [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5f5bd39056d4ebc973b6d8571a796ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2349e37642f4f4d9a3fe7b2c3d7a6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.119s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Cannot resize image /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'migration_context' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Ensure instance console log exists: /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:10 user nova-compute[70594]: INFO nova.compute.claims [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Claim successful on node user
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.076s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:10 user nova-compute[70594]: INFO nova.compute.claims [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Claim successful on node user
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:10 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Creating image(s)
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.124s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.128s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk 1073741824" returned: 0 in 0.043s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Creating image(s)
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.123s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Cannot resize image /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.objects.instance [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'migration_context' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.policy [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5f5bd39056d4ebc973b6d8571a796ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2349e37642f4f4d9a3fe7b2c3d7a6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Ensure instance console log exists: /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.131s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk 1073741824" returned: 0 in 0.044s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Successfully updated port: 09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquired lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.policy [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d46824c7e6747fd8ab11c920e79a58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae951bdcec3747a2a9fdd2f2ce28d3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.120s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Cannot resize image /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.objects.instance [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'migration_context' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Ensure instance console log exists: /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Successfully updated port: 19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquired lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-changed-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Refreshing instance network info cache due to event network-changed-09283b93-514b-489a-895b-c2864079e40e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] Acquiring lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-changed-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Refreshing instance network info cache due to event network-changed-19bcaabb-8678-4d58-88ce-5f087b2f0da3. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] Acquiring lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:12 user nova-compute[70594]: INFO nova.compute.claims [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Claim successful on node user
Jul 26 16:58:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Successfully created port: 7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updating instance_info_cache with network_info: [{"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Releasing lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Instance network_info: |[{"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] Acquired lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Refreshing network info cache for port 19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Start _get_guest_xml network_info=[{"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-379501789',display_name='tempest-ServersNegativeTestJSON-server-379501789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-379501789',id=2,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6ae07082de4f438c3cd0e80c27e39b',ramdisk_id='',reservation_id='r-7375cjiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1210249454',owner_user_name='tempest-ServersNegativeTestJSON-1210249454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:07Z,user_data=None,user_id='0475b99e94644a248b5a8b934b881c96',uuid=d51f1e40-acab-40c5-814d-ca5022cf04c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converting VIF {"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lazy-loading 'pci_devices' on Instance uuid d51f1e40-acab-40c5-814d-ca5022cf04c7 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:13 user nova-compute[70594]:   <uuid>d51f1e40-acab-40c5-814d-ca5022cf04c7</uuid>
Jul 26 16:58:13 user nova-compute[70594]:   <name>instance-00000002</name>
Jul 26 16:58:13 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:13 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:13 user nova-compute[70594]:   <metadata>
Jul 26 16:58:13 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:13 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:name>tempest-ServersNegativeTestJSON-server-379501789</nova:name>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:13</nova:creationTime>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:13 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:13 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:user uuid="0475b99e94644a248b5a8b934b881c96">tempest-ServersNegativeTestJSON-1210249454-project-member</nova:user>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:project uuid="6e6ae07082de4f438c3cd0e80c27e39b">tempest-ServersNegativeTestJSON-1210249454</nova:project>
Jul 26 16:58:13 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:port uuid="19bcaabb-8678-4d58-88ce-5f087b2f0da3">
Jul 26 16:58:13 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 26 16:58:13 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:13 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:13 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:13 user nova-compute[70594]:   </metadata>
Jul 26 16:58:13 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:13 user nova-compute[70594]:     <system>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="serial">d51f1e40-acab-40c5-814d-ca5022cf04c7</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="uuid">d51f1e40-acab-40c5-814d-ca5022cf04c7</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:13 user nova-compute[70594]:     </system>
Jul 26 16:58:13 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:13 user nova-compute[70594]:   <os>
Jul 26 16:58:13 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:13 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:13 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:13 user nova-compute[70594]:   </os>
Jul 26 16:58:13 user nova-compute[70594]:   <features>
Jul 26 16:58:13 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:13 user nova-compute[70594]:     <apic/>
Jul 26 16:58:13 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:13 user nova-compute[70594]:   </features>
Jul 26 16:58:13 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:13 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:13 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:13 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:13 user nova-compute[70594]:   </clock>
Jul 26 16:58:13 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:13 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:13 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:13 user nova-compute[70594]:   </cpu>
Jul 26 16:58:13 user nova-compute[70594]:   <devices>
Jul 26 16:58:13 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:13 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:13 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk"/>
Jul 26 16:58:13 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:13 user nova-compute[70594]:     </disk>
Jul 26 16:58:13 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:13 user nova-compute[70594]:       <mac address="fa:16:3e:5c:2d:b5"/>
Jul 26 16:58:13 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:13 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:13 user nova-compute[70594]:       <target dev="tap19bcaabb-86"/>
Jul 26 16:58:13 user nova-compute[70594]:     </interface>
Jul 26 16:58:13 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:13 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/console.log" append="off"/>
Jul 26 16:58:13 user nova-compute[70594]:     </serial>
Jul 26 16:58:13 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:13 user nova-compute[70594]:     <video>
Jul 26 16:58:13 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:13 user nova-compute[70594]:     </video>
Jul 26 16:58:13 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:13 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:13 user nova-compute[70594]:     </rng>
Jul 26 16:58:13 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:13 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:13 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:13 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:13 user nova-compute[70594]:   </devices>
Jul 26 16:58:13 user nova-compute[70594]: </domain>
Jul 26 16:58:13 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-379501789',display_name='tempest-ServersNegativeTestJSON-server-379501789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-379501789',id=2,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6ae07082de4f438c3cd0e80c27e39b',ramdisk_id='',reservation_id='r-7375cjiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1210249454',owner_user_name='tempest-ServersNegativeTestJSON-1210249454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:07Z,user_data=None,user_id='0475b99e94644a248b5a8b934b881c96',uuid=d51f1e40-acab-40c5-814d-ca5022cf04c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converting VIF {"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG os_vif [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Created schema index Interface.name {{(pid=70594) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Created schema index Port.name {{(pid=70594) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Created schema index Bridge.name {{(pid=70594) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [POLLOUT] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updating instance_info_cache with network_info: [{"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.neutron [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:13 user nova-compute[70594]: INFO oslo.privsep.daemon [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp7nucetkq/privsep.sock']
Jul 26 16:58:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:13 user sudo[80058]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp7nucetkq/privsep.sock
Jul 26 16:58:13 user sudo[80058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Releasing lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Instance network_info: |[{"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] Acquired lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Refreshing network info cache for port 09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Start _get_guest_xml network_info=[{"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1399289597',display_name='tempest-DeleteServersTestJSON-server-1399289597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1399289597',id=1,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4a12260d9e34ee2b6154a9f4f3281b9',ramdisk_id='',reservation_id='r-7l19n7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1821837487',owner_user_name='tempest-DeleteServersTestJSON-1821837487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:06Z,user_data=None,user_id='87ac9d550cb04cbd972aacae0a4af674',uuid=e28e16e1-92fb-48c9-9763-249ae2f1d906,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Converting VIF {"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lazy-loading 'pci_devices' on Instance uuid e28e16e1-92fb-48c9-9763-249ae2f1d906 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:13 user nova-compute[70594]:   <uuid>e28e16e1-92fb-48c9-9763-249ae2f1d906</uuid>
Jul 26 16:58:13 user nova-compute[70594]:   <name>instance-00000001</name>
Jul 26 16:58:13 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:13 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:13 user nova-compute[70594]:   <metadata>
Jul 26 16:58:13 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:13 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:name>tempest-DeleteServersTestJSON-server-1399289597</nova:name>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:13</nova:creationTime>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:13 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:13 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:user uuid="87ac9d550cb04cbd972aacae0a4af674">tempest-DeleteServersTestJSON-1821837487-project-member</nova:user>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:project uuid="a4a12260d9e34ee2b6154a9f4f3281b9">tempest-DeleteServersTestJSON-1821837487</nova:project>
Jul 26 16:58:13 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:13 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:13 user nova-compute[70594]:         <nova:port uuid="09283b93-514b-489a-895b-c2864079e40e">
Jul 26 16:58:13 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 16:58:13 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:13 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:13 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:13 user nova-compute[70594]:   </metadata>
Jul 26 16:58:13 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:13 user nova-compute[70594]:     <system>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="serial">e28e16e1-92fb-48c9-9763-249ae2f1d906</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="uuid">e28e16e1-92fb-48c9-9763-249ae2f1d906</entry>
Jul 26 16:58:13 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:13 user nova-compute[70594]:     </system>
Jul 26 16:58:13 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:13 user nova-compute[70594]:   <os>
Jul 26 16:58:13 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:13 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:13 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:13 user nova-compute[70594]:   </os>
Jul 26 16:58:13 user nova-compute[70594]:   <features>
Jul 26 16:58:13 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:13 user nova-compute[70594]:     <apic/>
Jul 26 16:58:13 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:13 user nova-compute[70594]:   </features>
Jul 26 16:58:13 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:13 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:13 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:13 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:13 user nova-compute[70594]:   </clock>
Jul 26 16:58:13 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:13 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:13 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:13 user nova-compute[70594]:   </cpu>
Jul 26 16:58:13 user nova-compute[70594]:   <devices>
Jul 26 16:58:13 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:13 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:13 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk"/>
Jul 26 16:58:13 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:13 user nova-compute[70594]:     </disk>
Jul 26 16:58:13 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:13 user nova-compute[70594]:       <mac address="fa:16:3e:06:b8:bc"/>
Jul 26 16:58:13 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:13 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:13 user nova-compute[70594]:       <target dev="tap09283b93-51"/>
Jul 26 16:58:13 user nova-compute[70594]:     </interface>
Jul 26 16:58:13 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:13 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/console.log" append="off"/>
Jul 26 16:58:13 user nova-compute[70594]:     </serial>
Jul 26 16:58:13 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:13 user nova-compute[70594]:     <video>
Jul 26 16:58:13 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:13 user nova-compute[70594]:     </video>
Jul 26 16:58:13 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:13 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:13 user nova-compute[70594]:     </rng>
Jul 26 16:58:13 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:13 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:13 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:13 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:13 user nova-compute[70594]:   </devices>
Jul 26 16:58:13 user nova-compute[70594]: </domain>
Jul 26 16:58:13 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1399289597',display_name='tempest-DeleteServersTestJSON-server-1399289597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1399289597',id=1,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4a12260d9e34ee2b6154a9f4f3281b9',ramdisk_id='',reservation_id='r-7l19n7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1821837487',owner_user_name='tempest-DeleteServersTestJSON-1821837487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:06Z,user_data=None,user_id='87ac9d550cb04cbd972aacae0a4af674',uuid=e28e16e1-92fb-48c9-9763-249ae2f1d906,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Converting VIF {"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG os_vif [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Creating image(s)
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.policy [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43c125b2ba334237878f2c655fed828a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbd171f41764f60b8abe257e5f6e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk 1073741824" returned: 0 in 0.044s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Cannot resize image /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.objects.instance [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'migration_context' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Ensure instance console log exists: /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.network.neutron [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updated VIF entry in instance network info cache for port 19bcaabb-8678-4d58-88ce-5f087b2f0da3. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.network.neutron [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updating instance_info_cache with network_info: [{"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c2d3ab88-6a2b-4ed8-bf58-2111a3c77ccf req-c1c4bc09-0d88-4be6-b16a-dda3800c84ad service nova] Releasing lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Successfully created port: b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user sudo[80058]: pam_unix(sudo:session): session closed for user root
Jul 26 16:58:15 user nova-compute[70594]: INFO oslo.privsep.daemon [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Spawned new privsep daemon via rootwrap
Jul 26 16:58:15 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 26 16:58:15 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 26 16:58:15 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 26 16:58:15 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80076
Jul 26 16:58:15 user nova-compute[70594]: WARNING oslo_privsep.priv_context [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] privsep daemon already running
Jul 26 16:58:15 user nova-compute[70594]: DEBUG nova.network.neutron [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updated VIF entry in instance network info cache for port 09283b93-514b-489a-895b-c2864079e40e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG nova.network.neutron [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updating instance_info_cache with network_info: [{"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG nova.network.neutron [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Successfully created port: f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-784f87d2-e9e3-4a5c-9984-b72cb0758e70 req-926f1d5d-6038-4665-9cf1-67bb1d9a5c59 service nova] Releasing lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09283b93-51, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09283b93-51, col_values=(('external_ids', {'iface-id': '09283b93-514b-489a-895b-c2864079e40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b8:bc', 'vm-uuid': 'e28e16e1-92fb-48c9-9763-249ae2f1d906'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user nova-compute[70594]: INFO os_vif [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51')
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19bcaabb-86, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19bcaabb-86, col_values=(('external_ids', {'iface-id': '19bcaabb-8678-4d58-88ce-5f087b2f0da3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:2d:b5', 'vm-uuid': 'd51f1e40-acab-40c5-814d-ca5022cf04c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:15 user nova-compute[70594]: INFO os_vif [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86')
Jul 26 16:58:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] No VIF found with MAC fa:16:3e:06:b8:bc, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] No VIF found with MAC fa:16:3e:5c:2d:b5, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Successfully updated port: 7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-changed-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Refreshing instance network info cache due to event network-changed-7ba2b845-fb6d-491b-943c-f6c7470ef865. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance network_info: |[{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.network.neutron [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Refreshing network info cache for port 7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Start _get_guest_xml network_info=[{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:17 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:17 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135380042',display_name='tempest-ServerRescueNegativeTestJSON-server-135380042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135380042',id=3,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-el3f5453',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:10Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=026577e6-2de3-45b9-adbf-7686e72a8c61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'pci_devices' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:17 user nova-compute[70594]:   <uuid>026577e6-2de3-45b9-adbf-7686e72a8c61</uuid>
Jul 26 16:58:17 user nova-compute[70594]:   <name>instance-00000003</name>
Jul 26 16:58:17 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:17 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:17 user nova-compute[70594]:   <metadata>
Jul 26 16:58:17 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:17 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:17 user nova-compute[70594]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-135380042</nova:name>
Jul 26 16:58:17 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:17</nova:creationTime>
Jul 26 16:58:17 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:17 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:17 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:17 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:user uuid="f5f5bd39056d4ebc973b6d8571a796ab">tempest-ServerRescueNegativeTestJSON-159727237-project-member</nova:user>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:project uuid="a2349e37642f4f4d9a3fe7b2c3d7a6c7">tempest-ServerRescueNegativeTestJSON-159727237</nova:project>
Jul 26 16:58:17 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:17 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:17 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:17 user nova-compute[70594]:         <nova:port uuid="7ba2b845-fb6d-491b-943c-f6c7470ef865">
Jul 26 16:58:17 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 26 16:58:17 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:17 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:17 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:17 user nova-compute[70594]:   </metadata>
Jul 26 16:58:17 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:17 user nova-compute[70594]:     <system>
Jul 26 16:58:17 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:17 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:17 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:17 user nova-compute[70594]:       <entry name="serial">026577e6-2de3-45b9-adbf-7686e72a8c61</entry>
Jul 26 16:58:17 user nova-compute[70594]:       <entry name="uuid">026577e6-2de3-45b9-adbf-7686e72a8c61</entry>
Jul 26 16:58:17 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:17 user nova-compute[70594]:     </system>
Jul 26 16:58:17 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:17 user nova-compute[70594]:   <os>
Jul 26 16:58:17 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:17 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:17 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:17 user nova-compute[70594]:   </os>
Jul 26 16:58:17 user nova-compute[70594]:   <features>
Jul 26 16:58:17 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:17 user nova-compute[70594]:     <apic/>
Jul 26 16:58:17 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:17 user nova-compute[70594]:   </features>
Jul 26 16:58:17 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:17 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:17 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:17 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:17 user nova-compute[70594]:   </clock>
Jul 26 16:58:17 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:17 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:17 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:17 user nova-compute[70594]:   </cpu>
Jul 26 16:58:17 user nova-compute[70594]:   <devices>
Jul 26 16:58:17 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:17 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:17 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk"/>
Jul 26 16:58:17 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:17 user nova-compute[70594]:     </disk>
Jul 26 16:58:17 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:17 user nova-compute[70594]:       <mac address="fa:16:3e:18:95:5f"/>
Jul 26 16:58:17 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:17 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:17 user nova-compute[70594]:       <target dev="tap7ba2b845-fb"/>
Jul 26 16:58:17 user nova-compute[70594]:     </interface>
Jul 26 16:58:17 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:17 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/console.log" append="off"/>
Jul 26 16:58:17 user nova-compute[70594]:     </serial>
Jul 26 16:58:17 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:17 user nova-compute[70594]:     <video>
Jul 26 16:58:17 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:17 user nova-compute[70594]:     </video>
Jul 26 16:58:17 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:17 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:17 user nova-compute[70594]:     </rng>
Jul 26 16:58:17 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:17 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:17 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:17 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:17 user nova-compute[70594]:   </devices>
Jul 26 16:58:17 user nova-compute[70594]: </domain>
Jul 26 16:58:17 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135380042',display_name='tempest-ServerRescueNegativeTestJSON-server-135380042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135380042',id=3,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-el3f5453',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:10Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=026577e6-2de3-45b9-adbf-7686e72a8c61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG os_vif [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ba2b845-fb, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ba2b845-fb, col_values=(('external_ids', {'iface-id': '7ba2b845-fb6d-491b-943c-f6c7470ef865', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:95:5f', 'vm-uuid': '026577e6-2de3-45b9-adbf-7686e72a8c61'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:17 user nova-compute[70594]: INFO os_vif [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb')
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:18:95:5f, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Successfully created port: 87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updated VIF entry in instance network info cache for port 7ba2b845-fb6d-491b-943c-f6c7470ef865. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:18 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:18 user nova-compute[70594]: INFO nova.compute.claims [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Claim successful on node user
Jul 26 16:58:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1574441f-e8a5-4ba5-ac48-a03aa36aa9d0 req-416fcd12-bdd3-45a2-a825-e516213e7769 service nova] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-d625a122-9e67-4f12-a444-8ebcccc12828 req-d0498266-f1f2-4dad-9e4f-410c80f22575 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d625a122-9e67-4f12-a444-8ebcccc12828 req-d0498266-f1f2-4dad-9e4f-410c80f22575 service nova] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d625a122-9e67-4f12-a444-8ebcccc12828 req-d0498266-f1f2-4dad-9e4f-410c80f22575 service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d625a122-9e67-4f12-a444-8ebcccc12828 req-d0498266-f1f2-4dad-9e4f-410c80f22575 service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-d625a122-9e67-4f12-a444-8ebcccc12828 req-d0498266-f1f2-4dad-9e4f-410c80f22575 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] No waiting events found dispatching network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:19 user nova-compute[70594]: WARNING nova.compute.manager [req-d625a122-9e67-4f12-a444-8ebcccc12828 req-d0498266-f1f2-4dad-9e4f-410c80f22575 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received unexpected event network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 for instance with vm_state building and task_state spawning.
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.policy [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9714a3b9e9d44f6b22c49d3d495d7ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f389f41a191747e68ceeb776fdcbff40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Creating image(s)
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk 1073741824" returned: 0 in 0.048s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Successfully updated port: b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Cannot resize image /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.objects.instance [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'migration_context' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-changed-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Refreshing instance network info cache due to event network-changed-b69a082e-0149-47b1-beef-e2a3b1351c73. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] Acquiring lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Ensure instance console log exists: /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Successfully updated port: f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-ed857c2a-458f-46d6-8bb4-00d561b0cf0e req-4aba2044-7ec3-4a76-b58f-57a440ce0b1a service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed857c2a-458f-46d6-8bb4-00d561b0cf0e req-4aba2044-7ec3-4a76-b58f-57a440ce0b1a service nova] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed857c2a-458f-46d6-8bb4-00d561b0cf0e req-4aba2044-7ec3-4a76-b58f-57a440ce0b1a service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed857c2a-458f-46d6-8bb4-00d561b0cf0e req-4aba2044-7ec3-4a76-b58f-57a440ce0b1a service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-ed857c2a-458f-46d6-8bb4-00d561b0cf0e req-4aba2044-7ec3-4a76-b58f-57a440ce0b1a service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] No waiting events found dispatching network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:21 user nova-compute[70594]: WARNING nova.compute.manager [req-ed857c2a-458f-46d6-8bb4-00d561b0cf0e req-4aba2044-7ec3-4a76-b58f-57a440ce0b1a service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received unexpected event network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 for instance with vm_state building and task_state spawning.
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-671e469a-dc0e-42df-8232-b8097c039b1d req-149256af-9221-4b49-8ecc-15c705a8e2af service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-671e469a-dc0e-42df-8232-b8097c039b1d req-149256af-9221-4b49-8ecc-15c705a8e2af service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-671e469a-dc0e-42df-8232-b8097c039b1d req-149256af-9221-4b49-8ecc-15c705a8e2af service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-671e469a-dc0e-42df-8232-b8097c039b1d req-149256af-9221-4b49-8ecc-15c705a8e2af service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-671e469a-dc0e-42df-8232-b8097c039b1d req-149256af-9221-4b49-8ecc-15c705a8e2af service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:21 user nova-compute[70594]: WARNING nova.compute.manager [req-671e469a-dc0e-42df-8232-b8097c039b1d req-149256af-9221-4b49-8ecc-15c705a8e2af service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state building and task_state spawning.
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390701.5944698, d51f1e40-acab-40c5-814d-ca5022cf04c7 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] VM Resumed (Lifecycle Event)
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Instance spawned successfully.
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390701.5962803, d51f1e40-acab-40c5-814d-ca5022cf04c7 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] VM Started (Lifecycle Event)
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Took 14.84 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Successfully created port: 58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:21 user nova-compute[70594]: INFO nova.compute.manager [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Took 15.63 seconds to build instance.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance network_info: |[{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] Acquired lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Refreshing network info cache for port b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Start _get_guest_xml network_info=[{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cea5c96-4aab-4772-9ada-dfcaaca2769a tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.786s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461824633',display_name='tempest-ServerRescueNegativeTestJSON-server-1461824633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461824633',id=4,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-mqt5vmwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:11Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=e88c0cbb-b2f5-4e81-817d-9dcc23b1c827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'pci_devices' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:22 user nova-compute[70594]:   <uuid>e88c0cbb-b2f5-4e81-817d-9dcc23b1c827</uuid>
Jul 26 16:58:22 user nova-compute[70594]:   <name>instance-00000004</name>
Jul 26 16:58:22 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:22 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:22 user nova-compute[70594]:   <metadata>
Jul 26 16:58:22 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:22 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1461824633</nova:name>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:22</nova:creationTime>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:22 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:22 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:user uuid="f5f5bd39056d4ebc973b6d8571a796ab">tempest-ServerRescueNegativeTestJSON-159727237-project-member</nova:user>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:project uuid="a2349e37642f4f4d9a3fe7b2c3d7a6c7">tempest-ServerRescueNegativeTestJSON-159727237</nova:project>
Jul 26 16:58:22 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:port uuid="b69a082e-0149-47b1-beef-e2a3b1351c73">
Jul 26 16:58:22 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 26 16:58:22 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:22 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:22 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:22 user nova-compute[70594]:   </metadata>
Jul 26 16:58:22 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:22 user nova-compute[70594]:     <system>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="serial">e88c0cbb-b2f5-4e81-817d-9dcc23b1c827</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="uuid">e88c0cbb-b2f5-4e81-817d-9dcc23b1c827</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:22 user nova-compute[70594]:     </system>
Jul 26 16:58:22 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:22 user nova-compute[70594]:   <os>
Jul 26 16:58:22 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:22 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:22 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:22 user nova-compute[70594]:   </os>
Jul 26 16:58:22 user nova-compute[70594]:   <features>
Jul 26 16:58:22 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:22 user nova-compute[70594]:     <apic/>
Jul 26 16:58:22 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:22 user nova-compute[70594]:   </features>
Jul 26 16:58:22 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:22 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:22 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:22 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:22 user nova-compute[70594]:   </clock>
Jul 26 16:58:22 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:22 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:22 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:22 user nova-compute[70594]:   </cpu>
Jul 26 16:58:22 user nova-compute[70594]:   <devices>
Jul 26 16:58:22 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:22 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:22 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk"/>
Jul 26 16:58:22 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:22 user nova-compute[70594]:     </disk>
Jul 26 16:58:22 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:22 user nova-compute[70594]:       <mac address="fa:16:3e:86:39:e7"/>
Jul 26 16:58:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:22 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:22 user nova-compute[70594]:       <target dev="tapb69a082e-01"/>
Jul 26 16:58:22 user nova-compute[70594]:     </interface>
Jul 26 16:58:22 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:22 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/console.log" append="off"/>
Jul 26 16:58:22 user nova-compute[70594]:     </serial>
Jul 26 16:58:22 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:22 user nova-compute[70594]:     <video>
Jul 26 16:58:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:22 user nova-compute[70594]:     </video>
Jul 26 16:58:22 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:22 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:22 user nova-compute[70594]:     </rng>
Jul 26 16:58:22 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:22 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:22 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:22 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:22 user nova-compute[70594]:   </devices>
Jul 26 16:58:22 user nova-compute[70594]: </domain>
Jul 26 16:58:22 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461824633',display_name='tempest-ServerRescueNegativeTestJSON-server-1461824633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461824633',id=4,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-mqt5vmwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:11Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=e88c0cbb-b2f5-4e81-817d-9dcc23b1c827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG os_vif [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb69a082e-01, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb69a082e-01, col_values=(('external_ids', {'iface-id': 'b69a082e-0149-47b1-beef-e2a3b1351c73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:39:e7', 'vm-uuid': 'e88c0cbb-b2f5-4e81-817d-9dcc23b1c827'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: INFO os_vif [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01')
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing instance network info cache due to event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:86:39:e7, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390702.501365, e28e16e1-92fb-48c9-9763-249ae2f1d906 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] VM Resumed (Lifecycle Event)
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Instance spawned successfully.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390702.507218, e28e16e1-92fb-48c9-9763-249ae2f1d906 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] VM Started (Lifecycle Event)
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390702.6526017, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Resumed (Lifecycle Event)
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance spawned successfully.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance network_info: |[{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Start _get_guest_xml network_info=[{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-961710201',display_name='tempest-ServerStableDeviceRescueTest-server-961710201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-961710201',id=5,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpQybbYth7qArntY2y7E3HyZ9i+RshZoLnj2sKjelEF04rnuFNHD3e0iuWndaLHwqvKxmXjAggVEmdBbCrxrzpCYISl7Io+U2io7MbvEE2otw7D6PrY/jIvF2m9oMpFEA==',key_name='tempest-keypair-167561146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae951bdcec3747a2a9fdd2f2ce28d3f0',ramdisk_id='',reservation_id='r-6zptpueb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-263207676',owner_user_name='tempest-ServerStableDeviceRescueTest-263207676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d46824c7e6747fd8ab11c920e79a58e',uuid=3f5841c2-e400-48d9-92dd-d776150c7849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converting VIF {"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:22 user nova-compute[70594]:   <uuid>3f5841c2-e400-48d9-92dd-d776150c7849</uuid>
Jul 26 16:58:22 user nova-compute[70594]:   <name>instance-00000005</name>
Jul 26 16:58:22 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:22 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:22 user nova-compute[70594]:   <metadata>
Jul 26 16:58:22 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:22 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-961710201</nova:name>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:22</nova:creationTime>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:22 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:22 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:user uuid="4d46824c7e6747fd8ab11c920e79a58e">tempest-ServerStableDeviceRescueTest-263207676-project-member</nova:user>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:project uuid="ae951bdcec3747a2a9fdd2f2ce28d3f0">tempest-ServerStableDeviceRescueTest-263207676</nova:project>
Jul 26 16:58:22 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:22 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:22 user nova-compute[70594]:         <nova:port uuid="f057bd54-b76f-4591-a8a7-b97bdb536421">
Jul 26 16:58:22 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 16:58:22 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:22 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:22 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:22 user nova-compute[70594]:   </metadata>
Jul 26 16:58:22 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:22 user nova-compute[70594]:     <system>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="serial">3f5841c2-e400-48d9-92dd-d776150c7849</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="uuid">3f5841c2-e400-48d9-92dd-d776150c7849</entry>
Jul 26 16:58:22 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:22 user nova-compute[70594]:     </system>
Jul 26 16:58:22 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:22 user nova-compute[70594]:   <os>
Jul 26 16:58:22 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:22 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:22 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:22 user nova-compute[70594]:   </os>
Jul 26 16:58:22 user nova-compute[70594]:   <features>
Jul 26 16:58:22 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:22 user nova-compute[70594]:     <apic/>
Jul 26 16:58:22 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:22 user nova-compute[70594]:   </features>
Jul 26 16:58:22 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:22 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:22 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:22 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:22 user nova-compute[70594]:   </clock>
Jul 26 16:58:22 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:22 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:22 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:22 user nova-compute[70594]:   </cpu>
Jul 26 16:58:22 user nova-compute[70594]:   <devices>
Jul 26 16:58:22 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:22 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:22 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk"/>
Jul 26 16:58:22 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:22 user nova-compute[70594]:     </disk>
Jul 26 16:58:22 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:22 user nova-compute[70594]:       <mac address="fa:16:3e:71:c3:4d"/>
Jul 26 16:58:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:22 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:22 user nova-compute[70594]:       <target dev="tapf057bd54-b7"/>
Jul 26 16:58:22 user nova-compute[70594]:     </interface>
Jul 26 16:58:22 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:22 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/console.log" append="off"/>
Jul 26 16:58:22 user nova-compute[70594]:     </serial>
Jul 26 16:58:22 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:22 user nova-compute[70594]:     <video>
Jul 26 16:58:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:22 user nova-compute[70594]:     </video>
Jul 26 16:58:22 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:22 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:22 user nova-compute[70594]:     </rng>
Jul 26 16:58:22 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:22 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:22 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:22 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:22 user nova-compute[70594]:   </devices>
Jul 26 16:58:22 user nova-compute[70594]: </domain>
Jul 26 16:58:22 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-961710201',display_name='tempest-ServerStableDeviceRescueTest-server-961710201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-961710201',id=5,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpQybbYth7qArntY2y7E3HyZ9i+RshZoLnj2sKjelEF04rnuFNHD3e0iuWndaLHwqvKxmXjAggVEmdBbCrxrzpCYISl7Io+U2io7MbvEE2otw7D6PrY/jIvF2m9oMpFEA==',key_name='tempest-keypair-167561146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae951bdcec3747a2a9fdd2f2ce28d3f0',ramdisk_id='',reservation_id='r-6zptpueb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-263207676',owner_user_name='tempest-ServerStableDeviceRescueTest-263207676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d46824c7e6747fd8ab11c920e79a58e',uuid=3f5841c2-e400-48d9-92dd-d776150c7849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converting VIF {"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG os_vif [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390702.6527588, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Started (Lifecycle Event)
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf057bd54-b7, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf057bd54-b7, col_values=(('external_ids', {'iface-id': 'f057bd54-b76f-4591-a8a7-b97bdb536421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:c3:4d', 'vm-uuid': '3f5841c2-e400-48d9-92dd-d776150c7849'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:22 user nova-compute[70594]: INFO os_vif [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7')
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:23 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:23 user nova-compute[70594]: INFO nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Took 16.86 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Successfully updated port: 87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No VIF found with MAC fa:16:3e:71:c3:4d, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:23 user nova-compute[70594]: INFO nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Took 13.33 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:23 user nova-compute[70594]: INFO nova.compute.manager [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Took 17.93 seconds to build instance.
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9b2996f-c96d-4de7-8d67-b81922f3e45d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.179s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-36b51355-7238-4b23-88a9-75b502fac776 req-01c3366e-1e20-49c5-90f8-d32deb2949fc service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-36b51355-7238-4b23-88a9-75b502fac776 req-01c3366e-1e20-49c5-90f8-d32deb2949fc service nova] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-36b51355-7238-4b23-88a9-75b502fac776 req-01c3366e-1e20-49c5-90f8-d32deb2949fc service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-36b51355-7238-4b23-88a9-75b502fac776 req-01c3366e-1e20-49c5-90f8-d32deb2949fc service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-36b51355-7238-4b23-88a9-75b502fac776 req-01c3366e-1e20-49c5-90f8-d32deb2949fc service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] No waiting events found dispatching network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:23 user nova-compute[70594]: WARNING nova.compute.manager [req-36b51355-7238-4b23-88a9-75b502fac776 req-01c3366e-1e20-49c5-90f8-d32deb2949fc service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received unexpected event network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e for instance with vm_state active and task_state None.
Jul 26 16:58:23 user nova-compute[70594]: INFO nova.compute.manager [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Took 14.37 seconds to build instance.
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9c84b43-3380-4758-a806-70d889e05a98 req-86abe7a9-ee71-44b8-945d-6b306fdf0585 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9c84b43-3380-4758-a806-70d889e05a98 req-86abe7a9-ee71-44b8-945d-6b306fdf0585 service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9c84b43-3380-4758-a806-70d889e05a98 req-86abe7a9-ee71-44b8-945d-6b306fdf0585 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9c84b43-3380-4758-a806-70d889e05a98 req-86abe7a9-ee71-44b8-945d-6b306fdf0585 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9c84b43-3380-4758-a806-70d889e05a98 req-86abe7a9-ee71-44b8-945d-6b306fdf0585 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:23 user nova-compute[70594]: WARNING nova.compute.manager [req-b9c84b43-3380-4758-a806-70d889e05a98 req-86abe7a9-ee71-44b8-945d-6b306fdf0585 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state active and task_state None.
Jul 26 16:58:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa49a1db-7167-4047-8e25-f8e2a3434d1a tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.499s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-changed-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Refreshing instance network info cache due to event network-changed-87faecb4-e13b-455f-911b-2c9f9e614336. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updated VIF entry in instance network info cache for port b69a082e-0149-47b1-beef-e2a3b1351c73. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-03e4b95f-aa23-4c26-a786-d8a421bc9027 req-aa357ee7-b1b1-4959-b26f-4ba4e22a926e service nova] Releasing lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updated VIF entry in instance network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-401833b0-12fb-4163-a538-5c41728d8f2c req-d6cfd56e-73f9-4701-a263-36b159830195 service nova] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance network_info: |[{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Refreshing network info cache for port 87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start _get_guest_xml network_info=[{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-58d12c2e-3cd5-4445-9dd1-b4200ed84891 req-5309797c-f2c9-4b6e-a40d-9ebaba77fedb service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-58d12c2e-3cd5-4445-9dd1-b4200ed84891 req-5309797c-f2c9-4b6e-a40d-9ebaba77fedb service nova] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-58d12c2e-3cd5-4445-9dd1-b4200ed84891 req-5309797c-f2c9-4b6e-a40d-9ebaba77fedb service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-58d12c2e-3cd5-4445-9dd1-b4200ed84891 req-5309797c-f2c9-4b6e-a40d-9ebaba77fedb service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-58d12c2e-3cd5-4445-9dd1-b4200ed84891 req-5309797c-f2c9-4b6e-a40d-9ebaba77fedb service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] No waiting events found dispatching network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:25 user nova-compute[70594]: WARNING nova.compute.manager [req-58d12c2e-3cd5-4445-9dd1-b4200ed84891 req-5309797c-f2c9-4b6e-a40d-9ebaba77fedb service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received unexpected event network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e for instance with vm_state active and task_state None.
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-1d85a1ed-3a76-479d-bc3d-35a7488af0ca req-9946c7ba-653f-47fb-a8f3-77d649174e3a service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1d85a1ed-3a76-479d-bc3d-35a7488af0ca req-9946c7ba-653f-47fb-a8f3-77d649174e3a service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1d85a1ed-3a76-479d-bc3d-35a7488af0ca req-9946c7ba-653f-47fb-a8f3-77d649174e3a service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1d85a1ed-3a76-479d-bc3d-35a7488af0ca req-9946c7ba-653f-47fb-a8f3-77d649174e3a service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-1d85a1ed-3a76-479d-bc3d-35a7488af0ca req-9946c7ba-653f-47fb-a8f3-77d649174e3a service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:25 user nova-compute[70594]: WARNING nova.compute.manager [req-1d85a1ed-3a76-479d-bc3d-35a7488af0ca req-9946c7ba-653f-47fb-a8f3-77d649174e3a service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state building and task_state spawning.
Jul 26 16:58:25 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:25 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.objects.instance [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'pci_devices' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:25 user nova-compute[70594]:   <uuid>a624beaa-5c38-4aee-9c04-4e888e85f0f9</uuid>
Jul 26 16:58:25 user nova-compute[70594]:   <name>instance-00000006</name>
Jul 26 16:58:25 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:25 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:25 user nova-compute[70594]:   <metadata>
Jul 26 16:58:25 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:25 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:25 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherB-server-478314950</nova:name>
Jul 26 16:58:25 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:25</nova:creationTime>
Jul 26 16:58:25 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:25 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:25 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:25 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:user uuid="43c125b2ba334237878f2c655fed828a">tempest-ServerActionsTestOtherB-1823585199-project-member</nova:user>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:project uuid="4fbd171f41764f60b8abe257e5f6e2c2">tempest-ServerActionsTestOtherB-1823585199</nova:project>
Jul 26 16:58:25 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:25 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:25 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:25 user nova-compute[70594]:         <nova:port uuid="87faecb4-e13b-455f-911b-2c9f9e614336">
Jul 26 16:58:25 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 16:58:25 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:25 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:25 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:25 user nova-compute[70594]:   </metadata>
Jul 26 16:58:25 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:25 user nova-compute[70594]:     <system>
Jul 26 16:58:25 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:25 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:25 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:25 user nova-compute[70594]:       <entry name="serial">a624beaa-5c38-4aee-9c04-4e888e85f0f9</entry>
Jul 26 16:58:25 user nova-compute[70594]:       <entry name="uuid">a624beaa-5c38-4aee-9c04-4e888e85f0f9</entry>
Jul 26 16:58:25 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:25 user nova-compute[70594]:     </system>
Jul 26 16:58:25 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:25 user nova-compute[70594]:   <os>
Jul 26 16:58:25 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:25 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:25 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:25 user nova-compute[70594]:   </os>
Jul 26 16:58:25 user nova-compute[70594]:   <features>
Jul 26 16:58:25 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:25 user nova-compute[70594]:     <apic/>
Jul 26 16:58:25 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:25 user nova-compute[70594]:   </features>
Jul 26 16:58:25 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:25 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:25 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:25 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:25 user nova-compute[70594]:   </clock>
Jul 26 16:58:25 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:25 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:25 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:25 user nova-compute[70594]:   </cpu>
Jul 26 16:58:25 user nova-compute[70594]:   <devices>
Jul 26 16:58:25 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:25 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:25 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk"/>
Jul 26 16:58:25 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:25 user nova-compute[70594]:     </disk>
Jul 26 16:58:25 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:25 user nova-compute[70594]:       <mac address="fa:16:3e:be:a5:cb"/>
Jul 26 16:58:25 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:25 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:25 user nova-compute[70594]:       <target dev="tap87faecb4-e1"/>
Jul 26 16:58:25 user nova-compute[70594]:     </interface>
Jul 26 16:58:25 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:25 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/console.log" append="off"/>
Jul 26 16:58:25 user nova-compute[70594]:     </serial>
Jul 26 16:58:25 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:25 user nova-compute[70594]:     <video>
Jul 26 16:58:25 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:25 user nova-compute[70594]:     </video>
Jul 26 16:58:25 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:25 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:25 user nova-compute[70594]:     </rng>
Jul 26 16:58:25 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:25 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:25 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:25 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:25 user nova-compute[70594]:   </devices>
Jul 26 16:58:25 user nova-compute[70594]: </domain>
Jul 26 16:58:25 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG os_vif [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87faecb4-e1, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87faecb4-e1, col_values=(('external_ids', {'iface-id': '87faecb4-e13b-455f-911b-2c9f9e614336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:a5:cb', 'vm-uuid': 'a624beaa-5c38-4aee-9c04-4e888e85f0f9'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: INFO os_vif [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1')
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No VIF found with MAC fa:16:3e:be:a5:cb, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Successfully updated port: 58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-b3b2bb8b-af33-4ece-8a56-69dcb197ecfc req-6229d6be-41ae-416f-a4e7-da2d0cf2f4fd service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b3b2bb8b-af33-4ece-8a56-69dcb197ecfc req-6229d6be-41ae-416f-a4e7-da2d0cf2f4fd service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b3b2bb8b-af33-4ece-8a56-69dcb197ecfc req-6229d6be-41ae-416f-a4e7-da2d0cf2f4fd service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b3b2bb8b-af33-4ece-8a56-69dcb197ecfc req-6229d6be-41ae-416f-a4e7-da2d0cf2f4fd service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-b3b2bb8b-af33-4ece-8a56-69dcb197ecfc req-6229d6be-41ae-416f-a4e7-da2d0cf2f4fd service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:27 user nova-compute[70594]: WARNING nova.compute.manager [req-b3b2bb8b-af33-4ece-8a56-69dcb197ecfc req-6229d6be-41ae-416f-a4e7-da2d0cf2f4fd service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state building and task_state spawning.
Jul 26 16:58:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-changed-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing instance network info cache due to event network-changed-58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG nova.network.neutron [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updated VIF entry in instance network info cache for port 87faecb4-e13b-455f-911b-2c9f9e614336. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG nova.network.neutron [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e8d308f1-8387-4e02-baa1-095a5ea67842 req-76274c9d-ea9c-4dab-8b0d-0a5660309e52 service nova] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-6f42594f-0529-4b81-8f64-2cd61c7e7652 req-1ecf2c91-2a1a-4eaa-aa72-f5bbea206ef9 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6f42594f-0529-4b81-8f64-2cd61c7e7652 req-1ecf2c91-2a1a-4eaa-aa72-f5bbea206ef9 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6f42594f-0529-4b81-8f64-2cd61c7e7652 req-1ecf2c91-2a1a-4eaa-aa72-f5bbea206ef9 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6f42594f-0529-4b81-8f64-2cd61c7e7652 req-1ecf2c91-2a1a-4eaa-aa72-f5bbea206ef9 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-6f42594f-0529-4b81-8f64-2cd61c7e7652 req-1ecf2c91-2a1a-4eaa-aa72-f5bbea206ef9 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:30 user nova-compute[70594]: WARNING nova.compute.manager [req-6f42594f-0529-4b81-8f64-2cd61c7e7652 req-1ecf2c91-2a1a-4eaa-aa72-f5bbea206ef9 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state building and task_state spawning.
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance network_info: |[{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Start _get_guest_xml network_info=[{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:30 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-932025414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-932025414',id=7,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/w6WOcQhiqS/3FyZmC4OK2c81YiTIVV6Ahj8uL8bOuqIQ2MwKz77Pp39C0RXj21WTnTmR/EVR7Hm439n7sCQbqXBnQ1TWgTDTl3x8OEKtFMjNb+lQxSaHpnqgo64OmWQ==',key_name='tempest-keypair-1077150454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-2sdwm5fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=ae56085e-6a66-494f-9ec0-2397ec7eb4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'pci_devices' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:30 user nova-compute[70594]:   <uuid>ae56085e-6a66-494f-9ec0-2397ec7eb4b0</uuid>
Jul 26 16:58:30 user nova-compute[70594]:   <name>instance-00000007</name>
Jul 26 16:58:30 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:30 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:30 user nova-compute[70594]:   <metadata>
Jul 26 16:58:30 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:30 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:30 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-932025414</nova:name>
Jul 26 16:58:30 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:30</nova:creationTime>
Jul 26 16:58:30 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:30 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:30 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:30 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:user uuid="e9714a3b9e9d44f6b22c49d3d495d7ad">tempest-AttachVolumeShelveTestJSON-1781489687-project-member</nova:user>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:project uuid="f389f41a191747e68ceeb776fdcbff40">tempest-AttachVolumeShelveTestJSON-1781489687</nova:project>
Jul 26 16:58:30 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:30 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:30 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:30 user nova-compute[70594]:         <nova:port uuid="58242289-8f80-4512-8cdb-0847afd81d42">
Jul 26 16:58:30 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 26 16:58:30 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:30 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:30 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:30 user nova-compute[70594]:   </metadata>
Jul 26 16:58:30 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:30 user nova-compute[70594]:     <system>
Jul 26 16:58:30 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:30 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:30 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:30 user nova-compute[70594]:       <entry name="serial">ae56085e-6a66-494f-9ec0-2397ec7eb4b0</entry>
Jul 26 16:58:30 user nova-compute[70594]:       <entry name="uuid">ae56085e-6a66-494f-9ec0-2397ec7eb4b0</entry>
Jul 26 16:58:30 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:30 user nova-compute[70594]:     </system>
Jul 26 16:58:30 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:30 user nova-compute[70594]:   <os>
Jul 26 16:58:30 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:30 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:30 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:30 user nova-compute[70594]:   </os>
Jul 26 16:58:30 user nova-compute[70594]:   <features>
Jul 26 16:58:30 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:30 user nova-compute[70594]:     <apic/>
Jul 26 16:58:30 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:30 user nova-compute[70594]:   </features>
Jul 26 16:58:30 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:30 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:30 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:30 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:30 user nova-compute[70594]:   </clock>
Jul 26 16:58:30 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:30 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:30 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:30 user nova-compute[70594]:   </cpu>
Jul 26 16:58:30 user nova-compute[70594]:   <devices>
Jul 26 16:58:30 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:30 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:30 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk"/>
Jul 26 16:58:30 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:30 user nova-compute[70594]:     </disk>
Jul 26 16:58:30 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:30 user nova-compute[70594]:       <mac address="fa:16:3e:f0:9b:cd"/>
Jul 26 16:58:30 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:30 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:30 user nova-compute[70594]:       <target dev="tap58242289-8f"/>
Jul 26 16:58:30 user nova-compute[70594]:     </interface>
Jul 26 16:58:30 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:30 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/console.log" append="off"/>
Jul 26 16:58:30 user nova-compute[70594]:     </serial>
Jul 26 16:58:30 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:30 user nova-compute[70594]:     <video>
Jul 26 16:58:30 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:30 user nova-compute[70594]:     </video>
Jul 26 16:58:30 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:30 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:30 user nova-compute[70594]:     </rng>
Jul 26 16:58:30 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:30 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:30 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:30 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:30 user nova-compute[70594]:   </devices>
Jul 26 16:58:30 user nova-compute[70594]: </domain>
Jul 26 16:58:30 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-932025414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-932025414',id=7,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/w6WOcQhiqS/3FyZmC4OK2c81YiTIVV6Ahj8uL8bOuqIQ2MwKz77Pp39C0RXj21WTnTmR/EVR7Hm439n7sCQbqXBnQ1TWgTDTl3x8OEKtFMjNb+lQxSaHpnqgo64OmWQ==',key_name='tempest-keypair-1077150454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-2sdwm5fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=ae56085e-6a66-494f-9ec0-2397ec7eb4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG os_vif [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58242289-8f, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58242289-8f, col_values=(('external_ids', {'iface-id': '58242289-8f80-4512-8cdb-0847afd81d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:9b:cd', 'vm-uuid': 'ae56085e-6a66-494f-9ec0-2397ec7eb4b0'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-49db6690-f027-4b7f-904a-a8b390adca7a req-8e2350fd-0469-4754-a40f-a7b5f1e8a4d7 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-49db6690-f027-4b7f-904a-a8b390adca7a req-8e2350fd-0469-4754-a40f-a7b5f1e8a4d7 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-49db6690-f027-4b7f-904a-a8b390adca7a req-8e2350fd-0469-4754-a40f-a7b5f1e8a4d7 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-49db6690-f027-4b7f-904a-a8b390adca7a req-8e2350fd-0469-4754-a40f-a7b5f1e8a4d7 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-49db6690-f027-4b7f-904a-a8b390adca7a req-8e2350fd-0469-4754-a40f-a7b5f1e8a4d7 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:30 user nova-compute[70594]: WARNING nova.compute.manager [req-49db6690-f027-4b7f-904a-a8b390adca7a req-8e2350fd-0469-4754-a40f-a7b5f1e8a4d7 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state building and task_state spawning.
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: INFO os_vif [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f')
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No VIF found with MAC fa:16:3e:f0:9b:cd, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390711.5244117, e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] VM Resumed (Lifecycle Event)
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance spawned successfully.
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390711.530723, e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] VM Started (Lifecycle Event)
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance spawned successfully.
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390711.710926, 3f5841c2-e400-48d9-92dd-d776150c7849 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:31 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Resumed (Lifecycle Event)
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390711.71737, 3f5841c2-e400-48d9-92dd-d776150c7849 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Started (Lifecycle Event)
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance spawned successfully.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390712.0064783, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Resumed (Lifecycle Event)
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Took 21.22 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Took 20.89 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Took 18.61 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390712.0819752, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:32 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Started (Lifecycle Event)
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-7bdd1dfc-b52a-4b6e-b8b2-f2f7e6098d73 req-7e4fa333-bc9c-4f95-a037-ff425ddd7eb9 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7bdd1dfc-b52a-4b6e-b8b2-f2f7e6098d73 req-7e4fa333-bc9c-4f95-a037-ff425ddd7eb9 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7bdd1dfc-b52a-4b6e-b8b2-f2f7e6098d73 req-7e4fa333-bc9c-4f95-a037-ff425ddd7eb9 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7bdd1dfc-b52a-4b6e-b8b2-f2f7e6098d73 req-7e4fa333-bc9c-4f95-a037-ff425ddd7eb9 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-7bdd1dfc-b52a-4b6e-b8b2-f2f7e6098d73 req-7e4fa333-bc9c-4f95-a037-ff425ddd7eb9 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:32 user nova-compute[70594]: WARNING nova.compute.manager [req-7bdd1dfc-b52a-4b6e-b8b2-f2f7e6098d73 req-7e4fa333-bc9c-4f95-a037-ff425ddd7eb9 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state building and task_state spawning.
Jul 26 16:58:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:33 user nova-compute[70594]: INFO nova.compute.manager [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Took 22.23 seconds to build instance.
Jul 26 16:58:33 user nova-compute[70594]: INFO nova.compute.manager [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Took 20.16 seconds to build instance.
Jul 26 16:58:33 user nova-compute[70594]: INFO nova.compute.manager [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Took 22.58 seconds to build instance.
Jul 26 16:58:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391bb8f2-5258-4e02-b72b-85531dcdcdf5 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.302s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updated VIF entry in instance network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-65e0a70e-ca50-410d-a63a-17df16495014 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.786s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:33 user nova-compute[70594]: WARNING nova.compute.manager [req-ae5de389-9a49-40b4-a04b-cde43fa932f8 req-dd5bed70-d707-4903-8bc6-3fada73d68ba service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state building and task_state spawning.
Jul 26 16:58:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-043d6c47-1661-4e31-9bf8-3d962dbedaca tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.799s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-5ef6737b-cca8-4e10-9322-156b5b300c34 req-27cb1bca-5f60-45fb-8e7d-14f39b93d5f0 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5ef6737b-cca8-4e10-9322-156b5b300c34 req-27cb1bca-5f60-45fb-8e7d-14f39b93d5f0 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5ef6737b-cca8-4e10-9322-156b5b300c34 req-27cb1bca-5f60-45fb-8e7d-14f39b93d5f0 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5ef6737b-cca8-4e10-9322-156b5b300c34 req-27cb1bca-5f60-45fb-8e7d-14f39b93d5f0 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-5ef6737b-cca8-4e10-9322-156b5b300c34 req-27cb1bca-5f60-45fb-8e7d-14f39b93d5f0 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:35 user nova-compute[70594]: WARNING nova.compute.manager [req-5ef6737b-cca8-4e10-9322-156b5b300c34 req-27cb1bca-5f60-45fb-8e7d-14f39b93d5f0 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state building and task_state spawning.
Jul 26 16:58:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390717.058242, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] VM Resumed (Lifecycle Event)
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance spawned successfully.
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-7aebd092-228b-4169-8811-7a8bf6f88066 req-b528b838-0b6c-4143-960e-e18a37385a11 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7aebd092-228b-4169-8811-7a8bf6f88066 req-b528b838-0b6c-4143-960e-e18a37385a11 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7aebd092-228b-4169-8811-7a8bf6f88066 req-b528b838-0b6c-4143-960e-e18a37385a11 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7aebd092-228b-4169-8811-7a8bf6f88066 req-b528b838-0b6c-4143-960e-e18a37385a11 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-7aebd092-228b-4169-8811-7a8bf6f88066 req-b528b838-0b6c-4143-960e-e18a37385a11 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:37 user nova-compute[70594]: WARNING nova.compute.manager [req-7aebd092-228b-4169-8811-7a8bf6f88066 req-b528b838-0b6c-4143-960e-e18a37385a11 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state building and task_state spawning.
Jul 26 16:58:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390717.0632303, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] VM Started (Lifecycle Event)
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:37 user nova-compute[70594]: INFO nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Took 18.21 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:38 user nova-compute[70594]: INFO nova.compute.manager [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Took 19.53 seconds to build instance.
Jul 26 16:58:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-43216ec3-b105-4aa4-927e-1fa3832bc2df tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.791s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:39 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:39 user nova-compute[70594]: INFO nova.compute.claims [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Claim successful on node user
Jul 26 16:58:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:40 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:40 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.311s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.policy [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '729f4ca3575940bdbf8091263986aa1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e093dc04d7404abbf947e0f0af0e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Creating image(s)
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "/opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "/opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "/opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "c68cd44c934091331bdc06cc589425e649671c0d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "c68cd44c934091331bdc06cc589425e649671c0d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:42 user nova-compute[70594]: INFO nova.compute.claims [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Claim successful on node user
Jul 26 16:58:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.part --force-share --output=json" returned: 0 in 0.256s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG nova.virt.images [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] cf1b6fb9-ea14-40be-bc84-847328c544e5 was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 16:58:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.part /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.part /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.converted" returned: 0 in 0.376s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Successfully created port: 8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d.converted --force-share --output=json" returned: 0 in 0.270s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "c68cd44c934091331bdc06cc589425e649671c0d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.950s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d --force-share --output=json" returned: 0 in 0.199s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "c68cd44c934091331bdc06cc589425e649671c0d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "c68cd44c934091331bdc06cc589425e649671c0d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.985s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d --force-share --output=json" returned: 0 in 0.181s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d,backing_fmt=raw /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d,backing_fmt=raw /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk 1073741824" returned: 0 in 0.235s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "c68cd44c934091331bdc06cc589425e649671c0d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c68cd44c934091331bdc06cc589425e649671c0d --force-share --output=json" returned: 0 in 0.168s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.policy [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4ffde3f244e4ac1923e33f7a9f048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74144c8b9bb4410983f5b3b496a1aa87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Creating image(s)
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "/opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "/opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "/opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Cannot resize image /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lazy-loading 'migration_context' on Instance uuid f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Ensure instance console log exists: /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.183s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.192s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk 1073741824" returned: 0 in 0.058s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Successfully updated port: 8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquired lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.235s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-changed-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Refreshing instance network info cache due to event network-changed-8ffc9433-9916-402e-b773-65c952436767. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] Acquiring lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Successfully created port: 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Cannot resize image /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'migration_context' on Instance uuid a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Ensure instance console log exists: /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updating instance_info_cache with network_info: [{"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Releasing lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Instance network_info: |[{"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] Acquired lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.neutron [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Refreshing network info cache for port 8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Start _get_guest_xml network_info=[{"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:58:23Z,direct_url=<?>,disk_format='qcow2',id=cf1b6fb9-ea14-40be-bc84-847328c544e5,min_disk=0,min_ram=0,name='',owner='25ec16da99e14a6497b20552918bcc56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:58:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': 'cf1b6fb9-ea14-40be-bc84-847328c544e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:45 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:45 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:58:23Z,direct_url=<?>,disk_format='qcow2',id=cf1b6fb9-ea14-40be-bc84-847328c544e5,min_disk=0,min_ram=0,name='',owner='25ec16da99e14a6497b20552918bcc56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:58:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1740148635',display_name='tempest-AttachSCSIVolumeTestJSON-server-1740148635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1740148635',id=8,image_ref='cf1b6fb9-ea14-40be-bc84-847328c544e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmctrsvc3pQ6J4mPa4wKGV1qY0SDli5JaKQa5GmXQsB9fnMxZkE0s1NyF7+wBqdqcK4YmDcDO/5kqw1S9+Pd159xlebO/YBTTlfylErHrlFUYGsyAqYZ813XIwFBRWUNg==',key_name='tempest-keypair-106241468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4e093dc04d7404abbf947e0f0af0e6d',ramdisk_id='',reservation_id='r-zdydbg54',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf1b6fb9-ea14-40be-bc84-847328c544e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1764624525',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1764624525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f4ca3575940bdbf8091263986aa1d',uuid=f113b65d-efa3-4f64-aec7-37f14c97a020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Converting VIF {"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lazy-loading 'pci_devices' on Instance uuid f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:45 user nova-compute[70594]:   <uuid>f113b65d-efa3-4f64-aec7-37f14c97a020</uuid>
Jul 26 16:58:45 user nova-compute[70594]:   <name>instance-00000008</name>
Jul 26 16:58:45 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:45 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:45 user nova-compute[70594]:   <metadata>
Jul 26 16:58:45 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:45 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:45 user nova-compute[70594]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1740148635</nova:name>
Jul 26 16:58:45 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:45</nova:creationTime>
Jul 26 16:58:45 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:45 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:45 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:45 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:user uuid="729f4ca3575940bdbf8091263986aa1d">tempest-AttachSCSIVolumeTestJSON-1764624525-project-member</nova:user>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:project uuid="a4e093dc04d7404abbf947e0f0af0e6d">tempest-AttachSCSIVolumeTestJSON-1764624525</nova:project>
Jul 26 16:58:45 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:45 user nova-compute[70594]:       <nova:root type="image" uuid="cf1b6fb9-ea14-40be-bc84-847328c544e5"/>
Jul 26 16:58:45 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:45 user nova-compute[70594]:         <nova:port uuid="8ffc9433-9916-402e-b773-65c952436767">
Jul 26 16:58:45 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 16:58:45 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:45 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:45 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:45 user nova-compute[70594]:   </metadata>
Jul 26 16:58:45 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:45 user nova-compute[70594]:     <system>
Jul 26 16:58:45 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:45 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:45 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:45 user nova-compute[70594]:       <entry name="serial">f113b65d-efa3-4f64-aec7-37f14c97a020</entry>
Jul 26 16:58:45 user nova-compute[70594]:       <entry name="uuid">f113b65d-efa3-4f64-aec7-37f14c97a020</entry>
Jul 26 16:58:45 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:45 user nova-compute[70594]:     </system>
Jul 26 16:58:45 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:45 user nova-compute[70594]:   <os>
Jul 26 16:58:45 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:45 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:45 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:45 user nova-compute[70594]:   </os>
Jul 26 16:58:45 user nova-compute[70594]:   <features>
Jul 26 16:58:45 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:45 user nova-compute[70594]:     <apic/>
Jul 26 16:58:45 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:45 user nova-compute[70594]:   </features>
Jul 26 16:58:45 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:45 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:45 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:45 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:45 user nova-compute[70594]:   </clock>
Jul 26 16:58:45 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:45 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:45 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:45 user nova-compute[70594]:   </cpu>
Jul 26 16:58:45 user nova-compute[70594]:   <devices>
Jul 26 16:58:45 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:45 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:45 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk"/>
Jul 26 16:58:45 user nova-compute[70594]:       <target dev="sda" bus="scsi"/>
Jul 26 16:58:45 user nova-compute[70594]:       <address type="drive" controller="0" unit="0"/>
Jul 26 16:58:45 user nova-compute[70594]:     </disk>
Jul 26 16:58:45 user nova-compute[70594]:     <disk type="file" device="cdrom">
Jul 26 16:58:45 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none"/>
Jul 26 16:58:45 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.config"/>
Jul 26 16:58:45 user nova-compute[70594]:       <target dev="sdb" bus="scsi"/>
Jul 26 16:58:45 user nova-compute[70594]:       <address type="drive" controller="0" unit="1"/>
Jul 26 16:58:45 user nova-compute[70594]:     </disk>
Jul 26 16:58:45 user nova-compute[70594]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 26 16:58:45 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:45 user nova-compute[70594]:       <mac address="fa:16:3e:f3:13:3b"/>
Jul 26 16:58:45 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:45 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:45 user nova-compute[70594]:       <target dev="tap8ffc9433-99"/>
Jul 26 16:58:45 user nova-compute[70594]:     </interface>
Jul 26 16:58:45 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:45 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/console.log" append="off"/>
Jul 26 16:58:45 user nova-compute[70594]:     </serial>
Jul 26 16:58:45 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:45 user nova-compute[70594]:     <video>
Jul 26 16:58:45 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:45 user nova-compute[70594]:     </video>
Jul 26 16:58:45 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:45 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:45 user nova-compute[70594]:     </rng>
Jul 26 16:58:45 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:45 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:45 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:45 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:45 user nova-compute[70594]:   </devices>
Jul 26 16:58:45 user nova-compute[70594]: </domain>
Jul 26 16:58:45 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1740148635',display_name='tempest-AttachSCSIVolumeTestJSON-server-1740148635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1740148635',id=8,image_ref='cf1b6fb9-ea14-40be-bc84-847328c544e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmctrsvc3pQ6J4mPa4wKGV1qY0SDli5JaKQa5GmXQsB9fnMxZkE0s1NyF7+wBqdqcK4YmDcDO/5kqw1S9+Pd159xlebO/YBTTlfylErHrlFUYGsyAqYZ813XIwFBRWUNg==',key_name='tempest-keypair-106241468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4e093dc04d7404abbf947e0f0af0e6d',ramdisk_id='',reservation_id='r-zdydbg54',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf1b6fb9-ea14-40be-bc84-847328c544e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1764624525',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1764624525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f4ca3575940bdbf8091263986aa1d',uuid=f113b65d-efa3-4f64-aec7-37f14c97a020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Converting VIF {"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG os_vif [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ffc9433-99, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ffc9433-99, col_values=(('external_ids', {'iface-id': '8ffc9433-9916-402e-b773-65c952436767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:13:3b', 'vm-uuid': 'f113b65d-efa3-4f64-aec7-37f14c97a020'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:45 user nova-compute[70594]: INFO os_vif [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99')
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No BDM found with device name sda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No VIF found with MAC fa:16:3e:f3:13:3b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Using config drive
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:46 user nova-compute[70594]: INFO nova.compute.claims [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Claim successful on node user
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Successfully updated port: 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquired lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-changed-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Refreshing instance network info cache due to event network-changed-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] Acquiring lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updated VIF entry in instance network info cache for port 8ffc9433-9916-402e-b773-65c952436767. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updating instance_info_cache with network_info: [{"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b5788c3-8e95-412d-a9d6-a1020dc48e4a req-827d0038-a459-4f17-b2b7-dd83fd877eb6 service nova] Releasing lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Creating config drive at /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.config
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1eb_kxor {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1eb_kxor" returned: 0 in 0.071s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Creating image(s)
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "/opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "/opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.policy [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '144454f557ab457f90a4d0d382fc3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da82b9f34b44fbba544f0bdc2b9d8b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.210s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updating instance_info_cache with network_info: [{"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Releasing lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Instance network_info: |[{"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] Acquired lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Refreshing network info cache for port 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Start _get_guest_xml network_info=[{"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:47 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:47 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-938206694',display_name='tempest-VolumesAdminNegativeTest-server-938206694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-938206694',id=9,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkaebApDzOXpyj2sQNxydXozvnDVQ6LtnA3r3FWZbZSc3dUS2C/uq4fIBcpOt1JcAtEX/KDbp9bygO9UQXJN1HbjAiqOdW+atUTH7HXhaWOKUg1MdObyCx14tiU1t8XRw==',key_name='tempest-keypair-227673292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74144c8b9bb4410983f5b3b496a1aa87',ramdisk_id='',reservation_id='r-usifwmif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2053670578',owner_user_name='tempest-VolumesAdminNegativeTest-2053670578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4ffde3f244e4ac1923e33f7a9f048ec',uuid=a94a2105-0e19-4d03-bea8-f9e44b6d7f79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converting VIF {"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'pci_devices' on Instance uuid a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk 1073741824" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:47 user nova-compute[70594]:   <uuid>a94a2105-0e19-4d03-bea8-f9e44b6d7f79</uuid>
Jul 26 16:58:47 user nova-compute[70594]:   <name>instance-00000009</name>
Jul 26 16:58:47 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:47 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:47 user nova-compute[70594]:   <metadata>
Jul 26 16:58:47 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:47 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:47 user nova-compute[70594]:       <nova:name>tempest-VolumesAdminNegativeTest-server-938206694</nova:name>
Jul 26 16:58:47 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:47</nova:creationTime>
Jul 26 16:58:47 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:47 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:47 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:47 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:user uuid="f4ffde3f244e4ac1923e33f7a9f048ec">tempest-VolumesAdminNegativeTest-2053670578-project-member</nova:user>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:project uuid="74144c8b9bb4410983f5b3b496a1aa87">tempest-VolumesAdminNegativeTest-2053670578</nova:project>
Jul 26 16:58:47 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:47 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:47 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:47 user nova-compute[70594]:         <nova:port uuid="61bf6da5-c2af-40e5-85bb-d0d1154cc4a5">
Jul 26 16:58:47 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 26 16:58:47 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:47 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:47 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:47 user nova-compute[70594]:   </metadata>
Jul 26 16:58:47 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:47 user nova-compute[70594]:     <system>
Jul 26 16:58:47 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:47 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:47 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:47 user nova-compute[70594]:       <entry name="serial">a94a2105-0e19-4d03-bea8-f9e44b6d7f79</entry>
Jul 26 16:58:47 user nova-compute[70594]:       <entry name="uuid">a94a2105-0e19-4d03-bea8-f9e44b6d7f79</entry>
Jul 26 16:58:47 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:47 user nova-compute[70594]:     </system>
Jul 26 16:58:47 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:47 user nova-compute[70594]:   <os>
Jul 26 16:58:47 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:47 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:47 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:47 user nova-compute[70594]:   </os>
Jul 26 16:58:47 user nova-compute[70594]:   <features>
Jul 26 16:58:47 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:47 user nova-compute[70594]:     <apic/>
Jul 26 16:58:47 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:47 user nova-compute[70594]:   </features>
Jul 26 16:58:47 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:47 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:47 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:47 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:47 user nova-compute[70594]:   </clock>
Jul 26 16:58:47 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:47 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:47 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:47 user nova-compute[70594]:   </cpu>
Jul 26 16:58:47 user nova-compute[70594]:   <devices>
Jul 26 16:58:47 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:47 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:47 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk"/>
Jul 26 16:58:47 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:47 user nova-compute[70594]:     </disk>
Jul 26 16:58:47 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:47 user nova-compute[70594]:       <mac address="fa:16:3e:d7:48:38"/>
Jul 26 16:58:47 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:47 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:47 user nova-compute[70594]:       <target dev="tap61bf6da5-c2"/>
Jul 26 16:58:47 user nova-compute[70594]:     </interface>
Jul 26 16:58:47 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:47 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/console.log" append="off"/>
Jul 26 16:58:47 user nova-compute[70594]:     </serial>
Jul 26 16:58:47 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:47 user nova-compute[70594]:     <video>
Jul 26 16:58:47 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:47 user nova-compute[70594]:     </video>
Jul 26 16:58:47 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:47 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:47 user nova-compute[70594]:     </rng>
Jul 26 16:58:47 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:47 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:47 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:47 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:47 user nova-compute[70594]:   </devices>
Jul 26 16:58:47 user nova-compute[70594]: </domain>
Jul 26 16:58:47 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-938206694',display_name='tempest-VolumesAdminNegativeTest-server-938206694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-938206694',id=9,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkaebApDzOXpyj2sQNxydXozvnDVQ6LtnA3r3FWZbZSc3dUS2C/uq4fIBcpOt1JcAtEX/KDbp9bygO9UQXJN1HbjAiqOdW+atUTH7HXhaWOKUg1MdObyCx14tiU1t8XRw==',key_name='tempest-keypair-227673292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74144c8b9bb4410983f5b3b496a1aa87',ramdisk_id='',reservation_id='r-usifwmif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2053670578',owner_user_name='tempest-VolumesAdminNegativeTest-2053670578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4ffde3f244e4ac1923e33f7a9f048ec',uuid=a94a2105-0e19-4d03-bea8-f9e44b6d7f79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converting VIF {"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG os_vif [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61bf6da5-c2, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61bf6da5-c2, col_values=(('external_ids', {'iface-id': '61bf6da5-c2af-40e5-85bb-d0d1154cc4a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:48:38', 'vm-uuid': 'a94a2105-0e19-4d03-bea8-f9e44b6d7f79'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:47 user nova-compute[70594]: INFO os_vif [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2')
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.172s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No VIF found with MAC fa:16:3e:d7:48:38, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Cannot resize image /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lazy-loading 'migration_context' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Ensure instance console log exists: /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updated VIF entry in instance network info cache for port 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updating instance_info_cache with network_info: [{"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d9b77d-6f76-4192-8d52-e0471e07229c req-653b50d0-76ad-4f0b-8e83-260854bcded0 service nova] Releasing lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-e5f5b112-a12e-4e95-988a-b65435128c90 req-93e4de7e-9ef2-48f8-8411-0deae7b3c2ff service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5f5b112-a12e-4e95-988a-b65435128c90 req-93e4de7e-9ef2-48f8-8411-0deae7b3c2ff service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5f5b112-a12e-4e95-988a-b65435128c90 req-93e4de7e-9ef2-48f8-8411-0deae7b3c2ff service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5f5b112-a12e-4e95-988a-b65435128c90 req-93e4de7e-9ef2-48f8-8411-0deae7b3c2ff service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-e5f5b112-a12e-4e95-988a-b65435128c90 req-93e4de7e-9ef2-48f8-8411-0deae7b3c2ff service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:48 user nova-compute[70594]: WARNING nova.compute.manager [req-e5f5b112-a12e-4e95-988a-b65435128c90 req-93e4de7e-9ef2-48f8-8411-0deae7b3c2ff service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state building and task_state spawning.
Jul 26 16:58:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Successfully created port: f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Successfully updated port: f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquired lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-changed-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Refreshing instance network info cache due to event network-changed-f81cc8f4-fa56-4da2-994b-31b53dc46242. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] Acquiring lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updating instance_info_cache with network_info: [{"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Releasing lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Instance network_info: |[{"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] Acquired lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Refreshing network info cache for port f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Start _get_guest_xml network_info=[{"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.016s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:50 user nova-compute[70594]: WARNING nova.compute.manager [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state building and task_state spawning.
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:50 user nova-compute[70594]: WARNING nova.compute.manager [req-c9ab6130-c74c-410e-bf78-c26d846d0146 req-27b72f78-f2f4-490f-8baa-6f0b9aa3e371 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state building and task_state spawning.
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 16:58:50 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:50 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-684046493',display_name='tempest-TestVolumeSwap-server-684046493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-684046493',id=10,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBz6vHObzeuvB9s0XHdSgr8PRdnxTguPwynIKN0tb54q+fXxz9I5b+yNz+8qyuVfEvdp4VgKu0uFFkX384juCNaiPvtP7+zKoAuHiyen56RI83MC+TjqYfllMtQs7dJOw==',key_name='tempest-keypair-705765736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da82b9f34b44fbba544f0bdc2b9d8b8',ramdisk_id='',reservation_id='r-epgn06x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1295928460',owner_user_name='tempest-TestVolumeSwap-1295928460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='144454f557ab457f90a4d0d382fc3aad',uuid=2c9162fc-40f6-462c-843a-fa279515db41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Converting VIF {"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:51 user nova-compute[70594]:   <uuid>2c9162fc-40f6-462c-843a-fa279515db41</uuid>
Jul 26 16:58:51 user nova-compute[70594]:   <name>instance-0000000a</name>
Jul 26 16:58:51 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:51 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:51 user nova-compute[70594]:   <metadata>
Jul 26 16:58:51 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:51 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:51 user nova-compute[70594]:       <nova:name>tempest-TestVolumeSwap-server-684046493</nova:name>
Jul 26 16:58:51 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:50</nova:creationTime>
Jul 26 16:58:51 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:51 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:51 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:51 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:user uuid="144454f557ab457f90a4d0d382fc3aad">tempest-TestVolumeSwap-1295928460-project-member</nova:user>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:project uuid="6da82b9f34b44fbba544f0bdc2b9d8b8">tempest-TestVolumeSwap-1295928460</nova:project>
Jul 26 16:58:51 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:51 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:51 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:51 user nova-compute[70594]:         <nova:port uuid="f81cc8f4-fa56-4da2-994b-31b53dc46242">
Jul 26 16:58:51 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 16:58:51 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:51 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:51 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:51 user nova-compute[70594]:   </metadata>
Jul 26 16:58:51 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:51 user nova-compute[70594]:     <system>
Jul 26 16:58:51 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:51 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:51 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:51 user nova-compute[70594]:       <entry name="serial">2c9162fc-40f6-462c-843a-fa279515db41</entry>
Jul 26 16:58:51 user nova-compute[70594]:       <entry name="uuid">2c9162fc-40f6-462c-843a-fa279515db41</entry>
Jul 26 16:58:51 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:51 user nova-compute[70594]:     </system>
Jul 26 16:58:51 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:51 user nova-compute[70594]:   <os>
Jul 26 16:58:51 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:51 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:51 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:51 user nova-compute[70594]:   </os>
Jul 26 16:58:51 user nova-compute[70594]:   <features>
Jul 26 16:58:51 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:51 user nova-compute[70594]:     <apic/>
Jul 26 16:58:51 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:51 user nova-compute[70594]:   </features>
Jul 26 16:58:51 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:51 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:51 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:51 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:51 user nova-compute[70594]:   </clock>
Jul 26 16:58:51 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:51 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:51 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:51 user nova-compute[70594]:   </cpu>
Jul 26 16:58:51 user nova-compute[70594]:   <devices>
Jul 26 16:58:51 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:51 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:51 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk"/>
Jul 26 16:58:51 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:51 user nova-compute[70594]:     </disk>
Jul 26 16:58:51 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:51 user nova-compute[70594]:       <mac address="fa:16:3e:1f:9e:53"/>
Jul 26 16:58:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:51 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:51 user nova-compute[70594]:       <target dev="tapf81cc8f4-fa"/>
Jul 26 16:58:51 user nova-compute[70594]:     </interface>
Jul 26 16:58:51 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:51 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/console.log" append="off"/>
Jul 26 16:58:51 user nova-compute[70594]:     </serial>
Jul 26 16:58:51 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:51 user nova-compute[70594]:     <video>
Jul 26 16:58:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:51 user nova-compute[70594]:     </video>
Jul 26 16:58:51 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:51 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:51 user nova-compute[70594]:     </rng>
Jul 26 16:58:51 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:51 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:51 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:51 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:51 user nova-compute[70594]:   </devices>
Jul 26 16:58:51 user nova-compute[70594]: </domain>
Jul 26 16:58:51 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-684046493',display_name='tempest-TestVolumeSwap-server-684046493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-684046493',id=10,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBz6vHObzeuvB9s0XHdSgr8PRdnxTguPwynIKN0tb54q+fXxz9I5b+yNz+8qyuVfEvdp4VgKu0uFFkX384juCNaiPvtP7+zKoAuHiyen56RI83MC+TjqYfllMtQs7dJOw==',key_name='tempest-keypair-705765736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da82b9f34b44fbba544f0bdc2b9d8b8',ramdisk_id='',reservation_id='r-epgn06x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1295928460',owner_user_name='tempest-TestVolumeSwap-1295928460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='144454f557ab457f90a4d0d382fc3aad',uuid=2c9162fc-40f6-462c-843a-fa279515db41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Converting VIF {"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG os_vif [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf81cc8f4-fa, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf81cc8f4-fa, col_values=(('external_ids', {'iface-id': 'f81cc8f4-fa56-4da2-994b-31b53dc46242', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:9e:53', 'vm-uuid': '2c9162fc-40f6-462c-843a-fa279515db41'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: INFO os_vif [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa')
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] No VIF found with MAC fa:16:3e:1f:9e:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:58:51 user nova-compute[70594]: INFO nova.compute.claims [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Claim successful on node user
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updated VIF entry in instance network info cache for port f81cc8f4-fa56-4da2-994b-31b53dc46242. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updating instance_info_cache with network_info: [{"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-868ea9f0-66fd-4faa-a873-a2fd1ba25899 req-e3180f0a-d06a-4b64-8dcf-0ee7a4ef1590 service nova] Releasing lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.016s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.network.neutron [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390732.7407808, f113b65d-efa3-4f64-aec7-37f14c97a020 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:52 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] VM Resumed (Lifecycle Event)
Jul 26 16:58:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:58:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Instance spawned successfully.
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:52 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390732.741568, f113b65d-efa3-4f64-aec7-37f14c97a020 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:52 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] VM Started (Lifecycle Event)
Jul 26 16:58:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-6be5c5ef-3de9-4a56-b0a2-3561fd431020 req-4ddc3f4b-6c8d-42a1-869e-ce2ddde46d6f service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6be5c5ef-3de9-4a56-b0a2-3561fd431020 req-4ddc3f4b-6c8d-42a1-869e-ce2ddde46d6f service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6be5c5ef-3de9-4a56-b0a2-3561fd431020 req-4ddc3f4b-6c8d-42a1-869e-ce2ddde46d6f service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6be5c5ef-3de9-4a56-b0a2-3561fd431020 req-4ddc3f4b-6c8d-42a1-869e-ce2ddde46d6f service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-6be5c5ef-3de9-4a56-b0a2-3561fd431020 req-4ddc3f4b-6c8d-42a1-869e-ce2ddde46d6f service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:53 user nova-compute[70594]: WARNING nova.compute.manager [req-6be5c5ef-3de9-4a56-b0a2-3561fd431020 req-4ddc3f4b-6c8d-42a1-869e-ce2ddde46d6f service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state building and task_state spawning.
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.policy [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e53b3525c5fc4e96b6e16e10ef5b05ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c072ae6afb4206856e0be592087840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:58:53 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:53 user nova-compute[70594]: INFO nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Took 11.79 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:58:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Creating image(s)
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "/opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.021s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "/opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:53 user nova-compute[70594]: INFO nova.compute.manager [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Took 13.99 seconds to build instance.
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.281s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d5521c7b-21e2-4817-b381-6b2fe01d5137 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.320s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.198s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk 1073741824" returned: 0 in 0.265s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.468s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390734.144635, a94a2105-0e19-4d03-bea8-f9e44b6d7f79 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] VM Resumed (Lifecycle Event)
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Instance spawned successfully.
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390734.1451688, a94a2105-0e19-4d03-bea8-f9e44b6d7f79 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] VM Started (Lifecycle Event)
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.275s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Took 10.05 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Cannot resize image /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lazy-loading 'migration_context' on Instance uuid e6902f86-dd2f-47d5-b48b-b63b014eeb9b {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Ensure instance console log exists: /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:54 user nova-compute[70594]: INFO nova.compute.manager [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Took 12.00 seconds to build instance.
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d6d941ae-0ed1-49fe-9ef2-0449a9e10ded tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.985s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.network.neutron [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Successfully created port: e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Skipping network cache update for instance because it is Building. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 26 16:58:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Skipping network cache update for instance because it is Building. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] No waiting events found dispatching network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:55 user nova-compute[70594]: WARNING nova.compute.manager [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received unexpected event network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 for instance with vm_state building and task_state spawning.
Jul 26 16:58:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] No waiting events found dispatching network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:58:55 user nova-compute[70594]: WARNING nova.compute.manager [req-46a1bb19-c47c-4cab-ad50-6ec5159a3ba5 req-d17e90d9-393c-423b-99d4-aefdaca86473 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received unexpected event network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 for instance with vm_state building and task_state spawning.
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid e28e16e1-92fb-48c9-9763-249ae2f1d906 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390736.1430724, 2c9162fc-40f6-462c-843a-fa279515db41 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] VM Resumed (Lifecycle Event)
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Instance spawned successfully.
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390736.1446736, 2c9162fc-40f6-462c-843a-fa279515db41 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] VM Started (Lifecycle Event)
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updating instance_info_cache with network_info: [{"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Took 9.14 seconds to spawn the instance on the hypervisor.
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-e28e16e1-92fb-48c9-9763-249ae2f1d906" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:58:56 user nova-compute[70594]: INFO nova.compute.manager [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Took 10.41 seconds to build instance.
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d923b16e-40b4-4006-bacf-1411552aeda3 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.643s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Successfully updated port: e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "refresh_cache-e6902f86-dd2f-47d5-b48b-b63b014eeb9b" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquired lock "refresh_cache-e6902f86-dd2f-47d5-b48b-b63b014eeb9b" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-changed-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Refreshing instance network info cache due to event network-changed-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] Acquiring lock "refresh_cache-e6902f86-dd2f-47d5-b48b-b63b014eeb9b" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.network.neutron [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Updating instance_info_cache with network_info: [{"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Releasing lock "refresh_cache-e6902f86-dd2f-47d5-b48b-b63b014eeb9b" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Instance network_info: |[{"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] Acquired lock "refresh_cache-e6902f86-dd2f-47d5-b48b-b63b014eeb9b" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.network.neutron [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Refreshing network info cache for port e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Start _get_guest_xml network_info=[{"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:57 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:57 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1119498941',display_name='tempest-VolumesNegativeTest-instance-1119498941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1119498941',id=11,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c072ae6afb4206856e0be592087840',ramdisk_id='',reservation_id='r-xr7jpf3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-393978929',owner_user_name='tempest-VolumesNegativeTest-393978929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:53Z,user_data=None,user_id='e53b3525c5fc4e96b6e16e10ef5b05ef',uuid=e6902f86-dd2f-47d5-b48b-b63b014eeb9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Converting VIF {"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lazy-loading 'pci_devices' on Instance uuid e6902f86-dd2f-47d5-b48b-b63b014eeb9b {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:58:57 user nova-compute[70594]:   <uuid>e6902f86-dd2f-47d5-b48b-b63b014eeb9b</uuid>
Jul 26 16:58:57 user nova-compute[70594]:   <name>instance-0000000b</name>
Jul 26 16:58:57 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:58:57 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:58:57 user nova-compute[70594]:   <metadata>
Jul 26 16:58:57 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:58:57 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:58:57 user nova-compute[70594]:       <nova:name>tempest-VolumesNegativeTest-instance-1119498941</nova:name>
Jul 26 16:58:57 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:58:57</nova:creationTime>
Jul 26 16:58:57 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:58:57 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:58:57 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:58:57 user nova-compute[70594]:       <nova:owner>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:user uuid="e53b3525c5fc4e96b6e16e10ef5b05ef">tempest-VolumesNegativeTest-393978929-project-member</nova:user>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:project uuid="f5c072ae6afb4206856e0be592087840">tempest-VolumesNegativeTest-393978929</nova:project>
Jul 26 16:58:57 user nova-compute[70594]:       </nova:owner>
Jul 26 16:58:57 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:58:57 user nova-compute[70594]:       <nova:ports>
Jul 26 16:58:57 user nova-compute[70594]:         <nova:port uuid="e5ddedc0-d8a2-4961-b86c-e9be2bb4470d">
Jul 26 16:58:57 user nova-compute[70594]:           <nova:ip type="fixed" address="192.168.233.127" ipVersion="4"/>
Jul 26 16:58:57 user nova-compute[70594]:         </nova:port>
Jul 26 16:58:57 user nova-compute[70594]:       </nova:ports>
Jul 26 16:58:57 user nova-compute[70594]:     </nova:instance>
Jul 26 16:58:57 user nova-compute[70594]:   </metadata>
Jul 26 16:58:57 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:58:57 user nova-compute[70594]:     <system>
Jul 26 16:58:57 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:58:57 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:58:57 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:58:57 user nova-compute[70594]:       <entry name="serial">e6902f86-dd2f-47d5-b48b-b63b014eeb9b</entry>
Jul 26 16:58:57 user nova-compute[70594]:       <entry name="uuid">e6902f86-dd2f-47d5-b48b-b63b014eeb9b</entry>
Jul 26 16:58:57 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:58:57 user nova-compute[70594]:     </system>
Jul 26 16:58:57 user nova-compute[70594]:   </sysinfo>
Jul 26 16:58:57 user nova-compute[70594]:   <os>
Jul 26 16:58:57 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:58:57 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:58:57 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:58:57 user nova-compute[70594]:   </os>
Jul 26 16:58:57 user nova-compute[70594]:   <features>
Jul 26 16:58:57 user nova-compute[70594]:     <acpi/>
Jul 26 16:58:57 user nova-compute[70594]:     <apic/>
Jul 26 16:58:57 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:58:57 user nova-compute[70594]:   </features>
Jul 26 16:58:57 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:58:57 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:58:57 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:58:57 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:58:57 user nova-compute[70594]:   </clock>
Jul 26 16:58:57 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:58:57 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:58:57 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:58:57 user nova-compute[70594]:   </cpu>
Jul 26 16:58:57 user nova-compute[70594]:   <devices>
Jul 26 16:58:57 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 16:58:57 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 16:58:57 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk"/>
Jul 26 16:58:57 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:58:57 user nova-compute[70594]:     </disk>
Jul 26 16:58:57 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:58:57 user nova-compute[70594]:       <mac address="fa:16:3e:0f:e8:6f"/>
Jul 26 16:58:57 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:57 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:58:57 user nova-compute[70594]:       <target dev="tape5ddedc0-d8"/>
Jul 26 16:58:57 user nova-compute[70594]:     </interface>
Jul 26 16:58:57 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:58:57 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/console.log" append="off"/>
Jul 26 16:58:57 user nova-compute[70594]:     </serial>
Jul 26 16:58:57 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:58:57 user nova-compute[70594]:     <video>
Jul 26 16:58:57 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:58:57 user nova-compute[70594]:     </video>
Jul 26 16:58:57 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:58:57 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:58:57 user nova-compute[70594]:     </rng>
Jul 26 16:58:57 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:58:57 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:58:57 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:58:57 user nova-compute[70594]:     </memballoon>
Jul 26 16:58:57 user nova-compute[70594]:   </devices>
Jul 26 16:58:57 user nova-compute[70594]: </domain>
Jul 26 16:58:57 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1119498941',display_name='tempest-VolumesNegativeTest-instance-1119498941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1119498941',id=11,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c072ae6afb4206856e0be592087840',ramdisk_id='',reservation_id='r-xr7jpf3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-393978929',owner_user_name='tempest-VolumesNegativeTest-393978929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:53Z,user_data=None,user_id='e53b3525c5fc4e96b6e16e10ef5b05ef',uuid=e6902f86-dd2f-47d5-b48b-b63b014eeb9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Converting VIF {"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG os_vif [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5ddedc0-d8, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5ddedc0-d8, col_values=(('external_ids', {'iface-id': 'e5ddedc0-d8a2-4961-b86c-e9be2bb4470d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:e8:6f', 'vm-uuid': 'e6902f86-dd2f-47d5-b48b-b63b014eeb9b'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:57 user nova-compute[70594]: INFO os_vif [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8')
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] No VIF found with MAC fa:16:3e:0f:e8:6f, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Updated VIF entry in instance network info cache for port e5ddedc0-d8a2-4961-b86c-e9be2bb4470d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Updating instance_info_cache with network_info: [{"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-51d9d22e-2eff-4d14-a93b-bbbeeddba2fb req-c2fd7b08-70ae-47ef-b58d-61a1c37ad016 service nova] Releasing lock "refresh_cache-e6902f86-dd2f-47d5-b48b-b63b014eeb9b" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:58:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-23b242e8-65a9-4635-b385-5fdf3d9a663a req-cc5f231f-444a-49f6-8af6-6b824abf26d1 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-23b242e8-65a9-4635-b385-5fdf3d9a663a req-cc5f231f-444a-49f6-8af6-6b824abf26d1 service nova] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-23b242e8-65a9-4635-b385-5fdf3d9a663a req-cc5f231f-444a-49f6-8af6-6b824abf26d1 service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-23b242e8-65a9-4635-b385-5fdf3d9a663a req-cc5f231f-444a-49f6-8af6-6b824abf26d1 service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-23b242e8-65a9-4635-b385-5fdf3d9a663a req-cc5f231f-444a-49f6-8af6-6b824abf26d1 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] No waiting events found dispatching network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:00 user nova-compute[70594]: WARNING nova.compute.manager [req-23b242e8-65a9-4635-b385-5fdf3d9a663a req-cc5f231f-444a-49f6-8af6-6b824abf26d1 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received unexpected event network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d for instance with vm_state building and task_state spawning.
Jul 26 16:59:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390742.156923, e6902f86-dd2f-47d5-b48b-b63b014eeb9b => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:59:02 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] VM Resumed (Lifecycle Event)
Jul 26 16:59:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-3dde90f0-5580-43f4-89a4-38d9f3d4e03a req-2e77938c-a11b-4aa1-aa87-04237926214b service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3dde90f0-5580-43f4-89a4-38d9f3d4e03a req-2e77938c-a11b-4aa1-aa87-04237926214b service nova] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3dde90f0-5580-43f4-89a4-38d9f3d4e03a req-2e77938c-a11b-4aa1-aa87-04237926214b service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3dde90f0-5580-43f4-89a4-38d9f3d4e03a req-2e77938c-a11b-4aa1-aa87-04237926214b service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-3dde90f0-5580-43f4-89a4-38d9f3d4e03a req-2e77938c-a11b-4aa1-aa87-04237926214b service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] No waiting events found dispatching network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:02 user nova-compute[70594]: WARNING nova.compute.manager [req-3dde90f0-5580-43f4-89a4-38d9f3d4e03a req-2e77938c-a11b-4aa1-aa87-04237926214b service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received unexpected event network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d for instance with vm_state building and task_state spawning.
Jul 26 16:59:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:59:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7328MB free_disk=25.784778594970703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:02 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Instance spawned successfully.
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:59:02 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390742.1585157, e6902f86-dd2f-47d5-b48b-b63b014eeb9b => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 16:59:02 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] VM Started (Lifecycle Event)
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 16:59:02 user nova-compute[70594]: INFO nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Took 9.55 seconds to spawn the instance on the hypervisor.
Jul 26 16:59:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 16:59:02 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 16:59:03 user nova-compute[70594]: INFO nova.compute.manager [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Took 11.57 seconds to build instance.
Jul 26 16:59:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-590ec89a-1f40-4ff7-9294-ff8ad26128f3 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.802s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e28e16e1-92fb-48c9-9763-249ae2f1d906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f113b65d-efa3-4f64-aec7-37f14c97a020 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 2c9162fc-40f6-462c-843a-fa279515db41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e6902f86-dd2f-47d5-b48b-b63b014eeb9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 16:59:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.982s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 16:59:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:59:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:26 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:59:26 user nova-compute[70594]: INFO nova.compute.claims [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Claim successful on node user
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:59:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:59:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:59:27 user nova-compute[70594]: INFO nova.virt.block_device [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Booting with volume 5d579203-5a1f-402b-8e15-8674312f3320 at /dev/vda
Jul 26 16:59:27 user nova-compute[70594]: DEBUG os_brick.utils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:27 user nova-compute[70594]: INFO oslo.privsep.daemon [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxy8owqby/privsep.sock']
Jul 26 16:59:27 user sudo[82154]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxy8owqby/privsep.sock
Jul 26 16:59:27 user sudo[82154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 26 16:59:27 user nova-compute[70594]: DEBUG nova.policy [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ccef7da90a6465489af0908b2627a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13545da03d4e1fa8c8d5aec922d68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:59:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully created port: 553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully created port: ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:28 user sudo[82154]: pam_unix(sudo:session): session closed for user root
Jul 26 16:59:28 user nova-compute[70594]: INFO oslo.privsep.daemon [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Spawned new privsep daemon via rootwrap
Jul 26 16:59:28 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 26 16:59:28 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 26 16:59:28 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 26 16:59:28 user nova-compute[70594]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82207
Jul 26 16:59:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb271c-2bc8-4a94-8f38-78e0364e8bee]: (2,) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f7643-38e6-47a0-aefe-e624dd2bc0ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:29 user nova-compute[70594]: WARNING os_brick.initiator.connectors.nvmeof [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8c8f5-9973-4896-90ca-ae3b4436fd6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc586f-96b0-45d6-af67-b1516ad4f9f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0d758-99b8-4e2b-a8b3-77d55f0050d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:29 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a94859-52f6-43f1-a1ed-571e82e2f549]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG os_brick.utils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== get_connector_properties: return (1900ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating existing volume attachment record: 9c706b4a-d16f-4e08-8a6b-44f3420d6ef4 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully created port: 00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully created port: c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:32 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully created port: 74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: 553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-553f56a5-67c1-4220-bc52-25aaa1cebcb8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port 553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fdda0362-5ee9-408b-a18c-318c219a7a0f req-2353755c-6a32-4ec0-8600-3d6f9ab809e7 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:59:34 user nova-compute[70594]: INFO nova.compute.claims [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Claim successful on node user
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:59:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:59:35 user nova-compute[70594]: INFO nova.virt.block_device [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Booting with volume c5e19756-6c79-46c9-a09f-8ed4fa7b5877 at /dev/vda
Jul 26 16:59:35 user nova-compute[70594]: DEBUG os_brick.utils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[91508b78-b302-440a-9000-24b2336a585f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ae2ec-7ef2-447d-9b29-eb98e766143a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed24b168-c0fb-408e-bb53-84f7a6693368]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[195645f1-0696-4cd0-bb87-471a137b5136]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:35 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fb4ce9-ae37-4e78-88b7-149987b8e4db]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG os_brick.utils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating existing volume attachment record: 65dd0ed9-1f7a-477f-b0c0-2ee507a30a02 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-ef89f7d7-9327-4e87-9844-94ff7efd540b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:35 user nova-compute[70594]: DEBUG nova.policy [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2666eb218f1342cf8e35a6630ec7cbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff34d709dbe4028b779b7bc2ddf671a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-13decf05-7be4-4152-b791-644842839cc2 req-741af6c8-502b-4553-bb0c-0a0ffdf39076 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:36 user nova-compute[70594]: INFO nova.virt.block_device [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Booting with volume 5c425d92-1440-4a2e-811d-43dd065fc5fa at /dev/vdb
Jul 26 16:59:36 user nova-compute[70594]: DEBUG os_brick.utils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6f7b7-24bd-4684-8f1b-1a4bdcf381fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f996a8bb-fda4-44f8-bc62-fc450fa8a9e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[00396e89-4824-4c13-bd52-48cda08af6fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222eca8-62f7-46dc-b913-ba0a519918fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:36 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1302a6c-7401-4498-ad57-d492d978db76]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG os_brick.utils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:36 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating existing volume attachment record: e3d0de22-9414-466b-9bf2-f798d67cb016 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully created port: 9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-ea9b3fcd-91c0-408c-b803-a8123845e257. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully created port: 8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-ddc6ab61-a7cd-450e-a871-219b444cfa7b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: 00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-338ec4a2-b767-4820-afb9-97722d644e70 req-29f7bc30-937f-41e7-81d2-f16df2dcfc90 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:38 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully created port: 785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-00f67f88-91ff-4694-98d4-68cfc34f7093. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port 00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.network.neutron [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-66ff1843-5686-4f86-ade7-cd180e4f0b40 req-273acf28-d8fd-49ec-9bcf-c5f02408b975 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully created port: f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Successfully updated port: 74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.compute.manager [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.compute.manager [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-74223b9a-fdb0-40e2-a89f-9f51e613240c. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully created port: 8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: 9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-c871be06-cc02-42a2-b0a3-6ac143a3c34f. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:42 user nova-compute[70594]: INFO nova.virt.block_device [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Booting with volume 198a2ca2-6a4a-4715-af3e-9fb19ff577ae at /dev/vdb
Jul 26 16:59:42 user nova-compute[70594]: DEBUG os_brick.utils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f845f3c-46d0-4847-adb0-38102ed4b9a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfafcfd-ea23-4f6c-b8ec-5e948989e26f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ade8e-a910-4f4e-ace6-dc01be1805b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b2f2d6-23b6-4781-ae44-dc74c84b2f9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: 60871186-c933-413b-be74-a261061e4437 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:42 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d64a3-906c-486d-b9f1-ef9119d9b740]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG os_brick.utils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating existing volume attachment record: 0014601e-90d0-4a5b-afe6-eb1ab7690ce9 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance network_info: |[{"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:42 user nova-compute[70594]: DEBUG nova.network.neutron [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port 74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:43 user nova-compute[70594]: INFO nova.virt.block_device [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Booting with volume 01a43c9e-cdc7-4fda-af62-749728fd4e88 at /dev/vdc
Jul 26 16:59:43 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: 1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG os_brick.utils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b0663-a0b2-4aa2-9c20-0934f7024292]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f410e110-615e-44b9-b359-3e7b43d87b07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f13432-7ebf-49b7-84c2-343b96bd933e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cbb9cd-0fac-4cd0-a06e-42ca89c8e898]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:43 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5132c8a1-923d-45a8-8b65-af678e207bc4]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG os_brick.utils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating existing volume attachment record: af662707-aa5f-4164-a9f1-f07343662785 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG nova.network.neutron [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updated VIF entry in instance network info cache for port 74223b9a-fdb0-40e2-a89f-9f51e613240c. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG nova.network.neutron [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-816d8f41-375b-4fcd-9363-c9c517e2ec0f req-de6c6d39-313e-4b3f-b390-071ff77cdf24 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:43 user nova-compute[70594]: DEBUG nova.network.neutron [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updated VIF entry in instance network info cache for port c871be06-cc02-42a2-b0a3-6ac143a3c34f. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: 8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-9d59da8a-c099-4245-b965-3f07c15d0088. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-60871186-c933-413b-be74-a261061e4437. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fa6b1657-e9bb-48fb-8545-9a02eb4c2785 req-e1cb3b4c-c519-4420-ab9a-06394263a2b0 service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 60871186-c933-413b-be74-a261061e4437 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: 785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG nova.network.neutron [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f95abc0-de25-41bf-a6f2-f0d771e5922a req-3f7de60a-21e7-4d14-b1f7-68820f105ffa service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Successfully updated port: 8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-785fc53b-ec01-487e-a17f-c30e6af84840. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-f4a80119-224e-427e-93e8-afbb621d7b07. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c3ce747f-c487-4ac0-a2d5-bec1e3b15ed9 req-7bc54352-9368-43bf-99ca-df1fe8748007 service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 16:59:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 16:59:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-8babdc9b-f953-4d18-b754-8355b0dd3109. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance network_info: |[{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updated VIF entry in instance network info cache for port 8babdc9b-f953-4d18-b754-8355b0dd3109. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a3488336-a105-45c4-9cf7-db0dcba153ac req-e1698768-fc0e-459e-959f-b1ef4ac80073 service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:49 user nova-compute[70594]: INFO nova.virt.block_device [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Booting with volume 4b25bf1e-eee4-4e43-93af-077bd614b1c5 at /dev/vdc
Jul 26 16:59:49 user nova-compute[70594]: DEBUG os_brick.utils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606088d-ae05-4deb-b813-9c6ae512152e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02c5c5-c80c-483a-a734-20b69671ef82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8fa4a9-8330-4593-83ce-9623c973f621]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e97210-be13-4a36-9cda-acf908106198]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:49 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da28840-37bd-4f6a-9fe5-1aaa2c760447]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG os_brick.utils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:49 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating existing volume attachment record: 5a8c071e-2b3b-4f05-9591-ce8c679b5d87 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:59:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Creating image(s)
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Ensure instance console log exists: /opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Start _get_guest_xml network_info=[{"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhVfYKuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b095024-0bcf-4aa9-818f-24b0efaba6c7', 'attached_at': '', 'detached_at': '', 'volume_id': '5d579203-5a1f-402b-8e15-8674312f3320', 'serial': '5d579203-5a1f-402b-8e15-8674312f3320'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '9c706b4a-d16f-4e08-8a6b-44f3420d6ef4', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYqHIosw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b095024-0bcf-4aa9-818f-24b0efaba6c7', 'attached_at': '', 'detached_at': '', 'volume_id': '5c425d92-1440-4a2e-811d-43dd065fc5fa', 'serial': '5c425d92-1440-4a2e-811d-43dd065fc5fa'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'e3d0de22-9414-466b-9bf2-f798d67cb016', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbCHaPgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b095024-0bcf-4aa9-818f-24b0efaba6c7', 'attached_at': '', 'detached_at': '', 'volume_id': '01a43c9e-cdc7-4fda-af62-749728fd4e88', 'serial': '01a43c9e-cdc7-4fda-af62-749728fd4e88'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': 'af662707-aa5f-4164-a9f1-f07343662785', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:59:50 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:59:50 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connector [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Factory for ISCSI on None {{(pid=70594) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhVfYKuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:50 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f982a612-32ab-4332-aab4-5a622697541f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 16:59:50 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5449a1-5fd6-4d44-9207-553ac0302f34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320] added
Jul 26 16:59:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c556a47-7069-49c4-a067-1b6e2e364c3f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca67c50c-011c-4150-b282-655e8bc3dd7f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dhVfYKuN {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dhVfYKuN" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[89478c5d-9a57-4570-8ef0-c9f7257fd15d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dhVfYKuN'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07628d0-948b-45c1-a5dd-1f14c1529b7d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933ea02-18f0-4ca7-82ff-7259db3f3c90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 26 16:59:50 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 26 16:59:50 user nova-compute[70594]:  {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 26 16:59:50 user nova-compute[70594]: 
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f08f19-fca2-40cb-9709-179c86a77d53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260]
Jul 26 16:59:50 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260] successful.
Jul 26 16:59:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bcd2cf-ad48-426b-8aa1-12d5814ce798]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465ba86-4d02-4d1b-9e48-c35c9ef5b0c1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e9fba-ac48-4c63-9438-8ec65323d41b]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 16:59:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhVfYKuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26465313363623963', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465313363623963', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYqHIosw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:51 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a59004f-937e-4e60-87f3-d408a0ad3317]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 16:59:51 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[076f686b-fa94-4e97-95da-335c22f9733a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa] added
Jul 26 16:59:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[047abd43-e932-4f6d-b627-01b48df98b66]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc32a41-345c-4128-a583-97e5e650cb03]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYqHIosw {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYqHIosw" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3990ee63-5ed3-49af-b690-d75ad6c3aff2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QYqHIosw'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa6168-6b17-4816-bde1-f9f6aba0a9c0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c04909-ceb5-4ac5-9400-e7c8e6263f76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6935e50a-0a17-4aac-a292-bb98db77c308]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260]
Jul 26 16:59:52 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260] successful.
Jul 26 16:59:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce8f44-232c-4dc8-a3b3-159b47edc1fd]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[26495695-387a-41e4-952c-3b1aed32190d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:52 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:52 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[07427df6-3278-41ad-bc5c-5c691265a1b5]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYqHIosw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 16:59:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23830393466306630', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830393466306630', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbCHaPgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:53 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:53 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:53 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0fb51d-f9ce-4db6-b798-8fda9b1d9b02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 16:59:53 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[270da3fb-d3a7-48ef-a163-82482c17b14d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88] added
Jul 26 16:59:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7114d74-022c-4d42-b471-e09ca960a0eb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52723d34-da5b-4e56-8cdd-baffcb0d790e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbCHaPgk {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbCHaPgk" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cdee3d-62aa-41e1-90f7-6114e16f824e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RbCHaPgk'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855a7ca-af34-4394-b82f-1711450738bb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f7bbf-afab-4abb-a048-fde5d4ce6275]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:53 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:53 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fde9c3-2a8e-4668-b857-554123ad5442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260]
Jul 26 16:59:53 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260] successful.
Jul 26 16:59:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42f8004-85f5-4d58-b64f-87ff10b0ba60]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5f842-46b4-4574-9a42-0198c3ae39f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:53 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:53 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:53 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:53 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d679a87b-0b78-4f9b-b07e-76b8bdcb6c5f]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbCHaPgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 16:59:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26161656263373464', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161656263373464', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b095024-0bcf-4aa9-818f-24b0efaba6c7 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] End _get_guest_xml xml=<domain type="kvm">
Jul 26 16:59:54 user nova-compute[70594]:   <uuid>9b095024-0bcf-4aa9-818f-24b0efaba6c7</uuid>
Jul 26 16:59:54 user nova-compute[70594]:   <name>instance-0000000c</name>
Jul 26 16:59:54 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 16:59:54 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 16:59:54 user nova-compute[70594]:   <metadata>
Jul 26 16:59:54 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 16:59:54 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 16:59:54 user nova-compute[70594]:       <nova:name>tempest-device-tagging-server-1256874851</nova:name>
Jul 26 16:59:54 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:59:50</nova:creationTime>
Jul 26 16:59:54 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 16:59:54 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 16:59:54 user nova-compute[70594]:       </nova:flavor>
Jul 26 16:59:54 user nova-compute[70594]:       <nova:owner>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:user uuid="7ccef7da90a6465489af0908b2627a96">tempest-TaggedBootDevicesTest-949285266-project-member</nova:user>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:project uuid="3e13545da03d4e1fa8c8d5aec922d68a">tempest-TaggedBootDevicesTest-949285266</nova:project>
Jul 26 16:59:54 user nova-compute[70594]:       </nova:owner>
Jul 26 16:59:54 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 16:59:54 user nova-compute[70594]:       <nova:ports>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="553f56a5-67c1-4220-bc52-25aaa1cebcb8">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="ef89f7d7-9327-4e87-9844-94ff7efd540b">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="ea9b3fcd-91c0-408c-b803-a8123845e257">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="ddc6ab61-a7cd-450e-a871-219b444cfa7b">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="00f67f88-91ff-4694-98d4-68cfc34f7093">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="c871be06-cc02-42a2-b0a3-6ac143a3c34f">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:         <nova:port uuid="74223b9a-fdb0-40e2-a89f-9f51e613240c">
Jul 26 16:59:54 user nova-compute[70594]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 26 16:59:54 user nova-compute[70594]:         </nova:port>
Jul 26 16:59:54 user nova-compute[70594]:       </nova:ports>
Jul 26 16:59:54 user nova-compute[70594]:     </nova:instance>
Jul 26 16:59:54 user nova-compute[70594]:   </metadata>
Jul 26 16:59:54 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 16:59:54 user nova-compute[70594]:     <system>
Jul 26 16:59:54 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 16:59:54 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 16:59:54 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 16:59:54 user nova-compute[70594]:       <entry name="serial">9b095024-0bcf-4aa9-818f-24b0efaba6c7</entry>
Jul 26 16:59:54 user nova-compute[70594]:       <entry name="uuid">9b095024-0bcf-4aa9-818f-24b0efaba6c7</entry>
Jul 26 16:59:54 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 16:59:54 user nova-compute[70594]:     </system>
Jul 26 16:59:54 user nova-compute[70594]:   </sysinfo>
Jul 26 16:59:54 user nova-compute[70594]:   <os>
Jul 26 16:59:54 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 16:59:54 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 16:59:54 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 16:59:54 user nova-compute[70594]:   </os>
Jul 26 16:59:54 user nova-compute[70594]:   <features>
Jul 26 16:59:54 user nova-compute[70594]:     <acpi/>
Jul 26 16:59:54 user nova-compute[70594]:     <apic/>
Jul 26 16:59:54 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 16:59:54 user nova-compute[70594]:   </features>
Jul 26 16:59:54 user nova-compute[70594]:   <clock offset="utc">
Jul 26 16:59:54 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 16:59:54 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 16:59:54 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 16:59:54 user nova-compute[70594]:   </clock>
Jul 26 16:59:54 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 16:59:54 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 16:59:54 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 16:59:54 user nova-compute[70594]:   </cpu>
Jul 26 16:59:54 user nova-compute[70594]:   <devices>
Jul 26 16:59:54 user nova-compute[70594]:     <disk type="file" device="cdrom">
Jul 26 16:59:54 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none"/>
Jul 26 16:59:54 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7/disk.config"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="hda" bus="ide"/>
Jul 26 16:59:54 user nova-compute[70594]:     </disk>
Jul 26 16:59:54 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 16:59:54 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 16:59:54 user nova-compute[70594]:       <source dev="/dev/sdb"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <serial>5d579203-5a1f-402b-8e15-8674312f3320</serial>
Jul 26 16:59:54 user nova-compute[70594]:     </disk>
Jul 26 16:59:54 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 16:59:54 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 16:59:54 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <serial>5c425d92-1440-4a2e-811d-43dd065fc5fa</serial>
Jul 26 16:59:54 user nova-compute[70594]:     </disk>
Jul 26 16:59:54 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 16:59:54 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 16:59:54 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="vdc" bus="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <serial>01a43c9e-cdc7-4fda-af62-749728fd4e88</serial>
Jul 26 16:59:54 user nova-compute[70594]:     </disk>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:6c:31:60"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tap553f56a5-67"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:41:cd:85"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tapef89f7d7-93"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:67:72:37"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tapea9b3fcd-91"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:c6:e2:3a"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tapddc6ab61-a7"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:a8:bd:93"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tap00f67f88-91"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:a5:97:b8"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tapc871be06-cc"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 16:59:54 user nova-compute[70594]:       <mac address="fa:16:3e:15:ee:e3"/>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 16:59:54 user nova-compute[70594]:       <target dev="tap74223b9a-fd"/>
Jul 26 16:59:54 user nova-compute[70594]:     </interface>
Jul 26 16:59:54 user nova-compute[70594]:     <serial type="pty">
Jul 26 16:59:54 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7/console.log" append="off"/>
Jul 26 16:59:54 user nova-compute[70594]:     </serial>
Jul 26 16:59:54 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 16:59:54 user nova-compute[70594]:     <video>
Jul 26 16:59:54 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 16:59:54 user nova-compute[70594]:     </video>
Jul 26 16:59:54 user nova-compute[70594]:     <rng model="virtio">
Jul 26 16:59:54 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 16:59:54 user nova-compute[70594]:     </rng>
Jul 26 16:59:54 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 16:59:54 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 16:59:54 user nova-compute[70594]:       <stats period="10"/>
Jul 26 16:59:54 user nova-compute[70594]:     </memballoon>
Jul 26 16:59:54 user nova-compute[70594]:   </devices>
Jul 26 16:59:54 user nova-compute[70594]: </domain>
Jul 26 16:59:54 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap553f56a5-67, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap553f56a5-67, col_values=(('external_ids', {'iface-id': '553f56a5-67c1-4220-bc52-25aaa1cebcb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:31:60', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef89f7d7-93, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef89f7d7-93, col_values=(('external_ids', {'iface-id': 'ef89f7d7-9327-4e87-9844-94ff7efd540b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:cd:85', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea9b3fcd-91, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea9b3fcd-91, col_values=(('external_ids', {'iface-id': 'ea9b3fcd-91c0-408c-b803-a8123845e257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:72:37', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc6ab61-a7, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddc6ab61-a7, col_values=(('external_ids', {'iface-id': 'ddc6ab61-a7cd-450e-a871-219b444cfa7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:e2:3a', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00f67f88-91, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00f67f88-91, col_values=(('external_ids', {'iface-id': '00f67f88-91ff-4694-98d4-68cfc34f7093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:bd:93', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc871be06-cc, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc871be06-cc, col_values=(('external_ids', {'iface-id': 'c871be06-cc02-42a2-b0a3-6ac143a3c34f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:97:b8', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74223b9a-fd, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74223b9a-fd, col_values=(('external_ids', {'iface-id': '74223b9a-fdb0-40e2-a89f-9f51e613240c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:ee:e3', 'vm-uuid': '9b095024-0bcf-4aa9-818f-24b0efaba6c7'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:54 user nova-compute[70594]: INFO os_vif [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd')
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] No BDM found with device name hda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] No VIF found with MAC fa:16:3e:6c:31:60, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:59:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] No VIF found with MAC fa:16:3e:a8:bd:93, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 16:59:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Using config drive
Jul 26 16:59:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Creating config drive at /opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7/disk.config
Jul 26 16:59:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpusymfch3 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpusymfch3" returned: 0 in 0.053s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 16:59:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 16:59:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 16:59:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updating instance_info_cache with network_info: [{"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:59:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Creating image(s)
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Ensure instance console log exists: /opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Start _get_guest_xml network_info=[{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFDZQYkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5e19756-6c79-46c9-a09f-8ed4fa7b5877', 'serial': 'c5e19756-6c79-46c9-a09f-8ed4fa7b5877'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '65dd0ed9-1f7a-477f-b0c0-2ee507a30a02', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbCFKLSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35', 'attached_at': '', 'detached_at': '', 'volume_id': '198a2ca2-6a4a-4715-af3e-9fb19ff577ae', 'serial': '198a2ca2-6a4a-4715-af3e-9fb19ff577ae'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '0014601e-90d0-4a5b-afe6-eb1ab7690ce9', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfiFNtcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35', 'attached_at': '', 'detached_at': '', 'volume_id': '4b25bf1e-eee4-4e43-93af-077bd614b1c5', 'serial': '4b25bf1e-eee4-4e43-93af-077bd614b1c5'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '5a8c071e-2b3b-4f05-9591-ce8c679b5d87', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 16:59:56 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:59:56 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFDZQYkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:56 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 16:59:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4d8cc6-948a-4d08-9e64-40988fd83695]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 16:59:56 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e694b66-3df9-4adf-9c4e-83728bd59487]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877] added
Jul 26 16:59:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5da13-7d74-4e72-808a-3c698da14a0c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[605e7e20-42fe-4e4e-9dea-246b08d67044]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XFDZQYkw {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XFDZQYkw" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bcf413-51e7-4185-a456-0628c839957d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XFDZQYkw'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a74de91-a8b9-4af6-bc83-3069fe18d7a4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f61981-59fe-4620-aa1d-8ff544367a63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:56 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:56 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:56 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:56 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f819b-6d59-4e28-af4e-62675f8afbcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260]
Jul 26 16:59:57 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260] successful.
Jul 26 16:59:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb24e30e-9cf6-47ce-8480-5af9437116f4 req-ed519886-08b6-4e82-b107-7d6eadc0126f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb24e30e-9cf6-47ce-8480-5af9437116f4 req-ed519886-08b6-4e82-b107-7d6eadc0126f service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb24e30e-9cf6-47ce-8480-5af9437116f4 req-ed519886-08b6-4e82-b107-7d6eadc0126f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb24e30e-9cf6-47ce-8480-5af9437116f4 req-ed519886-08b6-4e82-b107-7d6eadc0126f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb24e30e-9cf6-47ce-8480-5af9437116f4 req-ed519886-08b6-4e82-b107-7d6eadc0126f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:57 user nova-compute[70594]: WARNING nova.compute.manager [req-cb24e30e-9cf6-47ce-8480-5af9437116f4 req-ed519886-08b6-4e82-b107-7d6eadc0126f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 for instance with vm_state building and task_state spawning.
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b8e159-08e2-4c71-b839-7ef2539068bf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[868e48de-5fe9-4dc0-bcc1-03de403ad0a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:57 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:57 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:57 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 16:59:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:57 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:57 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:57 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 16:59:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da78a03-52e8-48e9-8cec-578551256fb4]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFDZQYkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-f9f18cf2-52bf-4a0f-bf26-ec54ccf6b60f req-2ab3e23c-a9de-4cb9-9688-1497254af0a3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f9f18cf2-52bf-4a0f-bf26-ec54ccf6b60f req-2ab3e23c-a9de-4cb9-9688-1497254af0a3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f9f18cf2-52bf-4a0f-bf26-ec54ccf6b60f req-2ab3e23c-a9de-4cb9-9688-1497254af0a3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f9f18cf2-52bf-4a0f-bf26-ec54ccf6b60f req-2ab3e23c-a9de-4cb9-9688-1497254af0a3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-f9f18cf2-52bf-4a0f-bf26-ec54ccf6b60f req-2ab3e23c-a9de-4cb9-9688-1497254af0a3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:57 user nova-compute[70594]: WARNING nova.compute.manager [req-f9f18cf2-52bf-4a0f-bf26-ec54ccf6b60f req-2ab3e23c-a9de-4cb9-9688-1497254af0a3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 for instance with vm_state building and task_state spawning.
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23366666333336166', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366666333336166', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbCFKLSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:58 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:58 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:58 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c57d2-df53-4fc5-b617-d596373946c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 16:59:58 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 16:59:58 user nova-compute[70594]: INFO nova.compute.claims [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Claim successful on node user
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c50e778-8a41-4cb6-89b4-789da8e24e26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae] added
Jul 26 16:59:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da63b96-bcbb-4efd-a95a-d895c8aa0302]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3ecab4-9ec8-4ce8-904a-0378ef4f41eb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbCFKLSf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbCFKLSf" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b710016-9ab4-4029-8a98-c6d912ee3353]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbCFKLSf'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[788a5874-9c0c-424d-a820-d5728adfba97]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d82fe9c-01ff-4c55-b8fc-13395b9a15c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b5be4-292b-442b-8643-06e20b019330]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260]
Jul 26 16:59:58 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260] successful.
Jul 26 16:59:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a261f-30c4-4d10-b969-05d86086a752]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58cf49d-5de4-41df-810d-f796e68caf1c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 16:59:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 16:59:58 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 16:59:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51591d-2bf1-46e1-909a-b999f3d601b0]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbCFKLSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 16:59:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.policy [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0475b99e94644a248b5a8b934b881c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6ae07082de4f438c3cd0e80c27e39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-16e4e473-07f4-486b-9dbd-0ebbe9200db9 req-2d4a945a-0ca3-4aba-912f-b3437ffc5f16 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-16e4e473-07f4-486b-9dbd-0ebbe9200db9 req-2d4a945a-0ca3-4aba-912f-b3437ffc5f16 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-16e4e473-07f4-486b-9dbd-0ebbe9200db9 req-2d4a945a-0ca3-4aba-912f-b3437ffc5f16 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-16e4e473-07f4-486b-9dbd-0ebbe9200db9 req-2d4a945a-0ca3-4aba-912f-b3437ffc5f16 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-16e4e473-07f4-486b-9dbd-0ebbe9200db9 req-2d4a945a-0ca3-4aba-912f-b3437ffc5f16 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-16e4e473-07f4-486b-9dbd-0ebbe9200db9 req-2d4a945a-0ca3-4aba-912f-b3437ffc5f16 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lazy-loading 'flavor' on Instance uuid e28e16e1-92fb-48c9-9763-249ae2f1d906 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-b5e6d764-7e31-4a0f-97d4-74458080ca88 req-122d0524-a39a-4dd2-a293-eb302c9c15f2 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 16:59:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Creating image(s)
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "/opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "/opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "/opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.141s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: INFO nova.compute.manager [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Attaching volume 24222b62-0759-4fd7-87b6-daf3174aefdf to /dev/vdb
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.utils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26266333230306266', 'path': '/dev/sdf'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266333230306266', 'path': '/dev/sdf'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk 1073741824" returned: 0 in 0.046s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe70476d-b5ca-4c51-8042-0f4faf6e04f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7fbd4-b976-4c62-93b2-a39ee22a193a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfiFNtcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 16:59:59 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ede610-e06b-4c4c-9c57-16445d70b60d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a28a342-3343-43d5-a47f-03acbeb88c72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 16:59:59 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING nova.compute.manager [req-8d8383d4-0438-4822-beed-7f0991bc0e5e req-45d62047-db4f-411b-896a-61084465d26e service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 for instance with vm_state building and task_state spawning.
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Successfully created port: 6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7865dd-e644-4ed1-9886-2dd26778fce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.209s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c9e58-6a6d-4b55-8848-a75e17b7f733]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5] added
Jul 26 16:59:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 16:59:59 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15902e5d-d587-41e6-90bc-6d0fdb7b5395]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.utils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] <== get_connector_properties: return (275ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updating existing volume attachment record: 8f9b0732-351d-4bd0-b15d-4f436fb6e468 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a801c1de-5db6-4777-86f6-7029beee681c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fc76ca-e147-47e3-8f67-57ab8c99abe5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfiFNtcx {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfiFNtcx" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[885d1848-de0a-4d74-852f-99cfaa169a41]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 16:59:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfiFNtcx'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Cannot resize image /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.objects.instance [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lazy-loading 'migration_context' on Instance uuid afa7d3a7-f79f-4914-a78d-a77b093d1cb1 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d46bed9-6674-4051-a231-24f57cbd6a77]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Ensure instance console log exists: /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[66887a93-e775-4eb9-9337-1788c9fe2a92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[955fd124-1181-471b-baba-1c521def744f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260]
Jul 26 17:00:00 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[effa81c2-58a9-4602-8620-bec40231fe57]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aeb967-b1f6-43b0-95b7-f5883f5af052]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:00 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.498s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b1019-a46f-451e-b25b-e0829eaed00e]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfiFNtcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Successfully updated port: 6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "refresh_cache-afa7d3a7-f79f-4914-a78d-a77b093d1cb1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquired lock "refresh_cache-afa7d3a7-f79f-4914-a78d-a77b093d1cb1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:00:00 user nova-compute[70594]: INFO nova.compute.manager [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Rescuing
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:00:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390801.128848, 9b095024-0bcf-4aa9-818f-24b0efaba6c7 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] VM Resumed (Lifecycle Event)
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance spawned successfully.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Updating instance_info_cache with network_info: [{"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Releasing lock "refresh_cache-afa7d3a7-f79f-4914-a78d-a77b093d1cb1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Instance network_info: |[{"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Start _get_guest_xml network_info=[{"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:01 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:00:01 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '26330376637383130', 'path': '/dev/sdg'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330376637383130', 'path': '/dev/sdg'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1461888267',display_name='tempest-ServersNegativeTestJSON-server-1461888267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1461888267',id=14,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6ae07082de4f438c3cd0e80c27e39b',ramdisk_id='',reservation_id='r-uul3sn4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1210249454',owner_user_name='tempest-ServersNegativeTestJSON-1210249454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:59Z,user_data=None,user_id='0475b99e94644a248b5a8b934b881c96',uuid=afa7d3a7-f79f-4914-a78d-a77b093d1cb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converting VIF {"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.objects.instance [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lazy-loading 'pci_devices' on Instance uuid afa7d3a7-f79f-4914-a78d-a77b093d1cb1 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390801.132208, 9b095024-0bcf-4aa9-818f-24b0efaba6c7 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] VM Started (Lifecycle Event)
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-727b02d1-4a9c-42e8-8a2f-9bb423bb3388 req-ec6d9d57-fb50-457c-adb8-e08c2a23fe1d service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-727b02d1-4a9c-42e8-8a2f-9bb423bb3388 req-ec6d9d57-fb50-457c-adb8-e08c2a23fe1d service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-727b02d1-4a9c-42e8-8a2f-9bb423bb3388 req-ec6d9d57-fb50-457c-adb8-e08c2a23fe1d service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-727b02d1-4a9c-42e8-8a2f-9bb423bb3388 req-ec6d9d57-fb50-457c-adb8-e08c2a23fe1d service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-727b02d1-4a9c-42e8-8a2f-9bb423bb3388 req-ec6d9d57-fb50-457c-adb8-e08c2a23fe1d service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:01 user nova-compute[70594]: WARNING nova.compute.manager [req-727b02d1-4a9c-42e8-8a2f-9bb423bb3388 req-ec6d9d57-fb50-457c-adb8-e08c2a23fe1d service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f for instance with vm_state building and task_state spawning.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:00:01 user nova-compute[70594]:   <uuid>afa7d3a7-f79f-4914-a78d-a77b093d1cb1</uuid>
Jul 26 17:00:01 user nova-compute[70594]:   <name>instance-0000000e</name>
Jul 26 17:00:01 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:00:01 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:00:01 user nova-compute[70594]:   <metadata>
Jul 26 17:00:01 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:00:01 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:name>tempest-ServersNegativeTestJSON-server-1461888267</nova:name>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:00:01</nova:creationTime>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:00:01 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:00:01 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:owner>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:user uuid="0475b99e94644a248b5a8b934b881c96">tempest-ServersNegativeTestJSON-1210249454-project-member</nova:user>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:project uuid="6e6ae07082de4f438c3cd0e80c27e39b">tempest-ServersNegativeTestJSON-1210249454</nova:project>
Jul 26 17:00:01 user nova-compute[70594]:       </nova:owner>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:ports>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="6e9ea0b8-0c26-439c-a81b-c522f8285930">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:       </nova:ports>
Jul 26 17:00:01 user nova-compute[70594]:     </nova:instance>
Jul 26 17:00:01 user nova-compute[70594]:   </metadata>
Jul 26 17:00:01 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:00:01 user nova-compute[70594]:     <system>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="serial">afa7d3a7-f79f-4914-a78d-a77b093d1cb1</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="uuid">afa7d3a7-f79f-4914-a78d-a77b093d1cb1</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:00:01 user nova-compute[70594]:     </system>
Jul 26 17:00:01 user nova-compute[70594]:   </sysinfo>
Jul 26 17:00:01 user nova-compute[70594]:   <os>
Jul 26 17:00:01 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:00:01 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:00:01 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:00:01 user nova-compute[70594]:   </os>
Jul 26 17:00:01 user nova-compute[70594]:   <features>
Jul 26 17:00:01 user nova-compute[70594]:     <acpi/>
Jul 26 17:00:01 user nova-compute[70594]:     <apic/>
Jul 26 17:00:01 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:00:01 user nova-compute[70594]:   </features>
Jul 26 17:00:01 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:00:01 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:00:01 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:00:01 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:00:01 user nova-compute[70594]:   </clock>
Jul 26 17:00:01 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:00:01 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:00:01 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:00:01 user nova-compute[70594]:   </cpu>
Jul 26 17:00:01 user nova-compute[70594]:   <devices>
Jul 26 17:00:01 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:00:01 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:00:01 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:     </disk>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:b0:5a:95"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap6e9ea0b8-0c"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:00:01 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/console.log" append="off"/>
Jul 26 17:00:01 user nova-compute[70594]:     </serial>
Jul 26 17:00:01 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:00:01 user nova-compute[70594]:     <video>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:     </video>
Jul 26 17:00:01 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:00:01 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:00:01 user nova-compute[70594]:     </rng>
Jul 26 17:00:01 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:00:01 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:00:01 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:00:01 user nova-compute[70594]:     </memballoon>
Jul 26 17:00:01 user nova-compute[70594]:   </devices>
Jul 26 17:00:01 user nova-compute[70594]: </domain>
Jul 26 17:00:01 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1461888267',display_name='tempest-ServersNegativeTestJSON-server-1461888267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1461888267',id=14,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6ae07082de4f438c3cd0e80c27e39b',ramdisk_id='',reservation_id='r-uul3sn4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1210249454',owner_user_name='tempest-ServersNegativeTestJSON-1210249454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:59Z,user_data=None,user_id='0475b99e94644a248b5a8b934b881c96',uuid=afa7d3a7-f79f-4914-a78d-a77b093d1cb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converting VIF {"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Took 10.96 seconds to spawn the instance on the hypervisor.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9ea0b8-0c, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e9ea0b8-0c, col_values=(('external_ids', {'iface-id': '6e9ea0b8-0c26-439c-a81b-c522f8285930', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5a:95', 'vm-uuid': 'afa7d3a7-f79f-4914-a78d-a77b093d1cb1'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: INFO os_vif [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c')
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.objects.instance [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lazy-loading 'pci_devices' on Instance uuid 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:00:01 user nova-compute[70594]:   <uuid>58bf4d75-dfda-4ba8-91bd-5afb2a20ef35</uuid>
Jul 26 17:00:01 user nova-compute[70594]:   <name>instance-0000000d</name>
Jul 26 17:00:01 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:00:01 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:00:01 user nova-compute[70594]:   <metadata>
Jul 26 17:00:01 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:00:01 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:name>tempest-device-tagging-server-1255705891</nova:name>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:creationTime>2023-07-26 16:59:56</nova:creationTime>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:00:01 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:00:01 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:owner>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:user uuid="2666eb218f1342cf8e35a6630ec7cbe4">tempest-TaggedBootDevicesTest_v242-826283036-project-member</nova:user>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:project uuid="2ff34d709dbe4028b779b7bc2ddf671a">tempest-TaggedBootDevicesTest_v242-826283036</nova:project>
Jul 26 17:00:01 user nova-compute[70594]:       </nova:owner>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:00:01 user nova-compute[70594]:       <nova:ports>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="9d59da8a-c099-4245-b965-3f07c15d0088">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="60871186-c933-413b-be74-a261061e4437">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.190" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="8b00967a-2f00-4507-9a9a-e40bb2a0cdeb">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="785fc53b-ec01-487e-a17f-c30e6af84840">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="f4a80119-224e-427e-93e8-afbb621d7b07">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:         <nova:port uuid="8babdc9b-f953-4d18-b754-8355b0dd3109">
Jul 26 17:00:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 26 17:00:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:01 user nova-compute[70594]:       </nova:ports>
Jul 26 17:00:01 user nova-compute[70594]:     </nova:instance>
Jul 26 17:00:01 user nova-compute[70594]:   </metadata>
Jul 26 17:00:01 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:00:01 user nova-compute[70594]:     <system>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="serial">58bf4d75-dfda-4ba8-91bd-5afb2a20ef35</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="uuid">58bf4d75-dfda-4ba8-91bd-5afb2a20ef35</entry>
Jul 26 17:00:01 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:00:01 user nova-compute[70594]:     </system>
Jul 26 17:00:01 user nova-compute[70594]:   </sysinfo>
Jul 26 17:00:01 user nova-compute[70594]:   <os>
Jul 26 17:00:01 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:00:01 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:00:01 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:00:01 user nova-compute[70594]:   </os>
Jul 26 17:00:01 user nova-compute[70594]:   <features>
Jul 26 17:00:01 user nova-compute[70594]:     <acpi/>
Jul 26 17:00:01 user nova-compute[70594]:     <apic/>
Jul 26 17:00:01 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:00:01 user nova-compute[70594]:   </features>
Jul 26 17:00:01 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:00:01 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:00:01 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:00:01 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:00:01 user nova-compute[70594]:   </clock>
Jul 26 17:00:01 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:00:01 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:00:01 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:00:01 user nova-compute[70594]:   </cpu>
Jul 26 17:00:01 user nova-compute[70594]:   <devices>
Jul 26 17:00:01 user nova-compute[70594]:     <disk type="file" device="cdrom">
Jul 26 17:00:01 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none"/>
Jul 26 17:00:01 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35/disk.config"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="hda" bus="ide"/>
Jul 26 17:00:01 user nova-compute[70594]:     </disk>
Jul 26 17:00:01 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:00:01 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:01 user nova-compute[70594]:       <source dev="/dev/sde"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <serial>c5e19756-6c79-46c9-a09f-8ed4fa7b5877</serial>
Jul 26 17:00:01 user nova-compute[70594]:     </disk>
Jul 26 17:00:01 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:00:01 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:01 user nova-compute[70594]:       <source dev="/dev/sdf"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <serial>198a2ca2-6a4a-4715-af3e-9fb19ff577ae</serial>
Jul 26 17:00:01 user nova-compute[70594]:     </disk>
Jul 26 17:00:01 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:00:01 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:01 user nova-compute[70594]:       <source dev="/dev/sdg"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="vdc" bus="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <serial>4b25bf1e-eee4-4e43-93af-077bd614b1c5</serial>
Jul 26 17:00:01 user nova-compute[70594]:     </disk>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:4f:90:ce"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap9d59da8a-c0"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:df:fb:5e"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap60871186-c9"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:46:5a:8d"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap1b3d7ba1-81"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:4b:38:20"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap8b00967a-2f"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:79:00:6d"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap785fc53b-ec"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:b7:ea:51"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tapf4a80119-22"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:01 user nova-compute[70594]:       <mac address="fa:16:3e:f9:21:10"/>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:01 user nova-compute[70594]:       <target dev="tap8babdc9b-f9"/>
Jul 26 17:00:01 user nova-compute[70594]:     </interface>
Jul 26 17:00:01 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:00:01 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35/console.log" append="off"/>
Jul 26 17:00:01 user nova-compute[70594]:     </serial>
Jul 26 17:00:01 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:00:01 user nova-compute[70594]:     <video>
Jul 26 17:00:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:01 user nova-compute[70594]:     </video>
Jul 26 17:00:01 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:00:01 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:00:01 user nova-compute[70594]:     </rng>
Jul 26 17:00:01 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:00:01 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:00:01 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:00:01 user nova-compute[70594]:     </memballoon>
Jul 26 17:00:01 user nova-compute[70594]:   </devices>
Jul 26 17:00:01 user nova-compute[70594]: </domain>
Jul 26 17:00:01 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d59da8a-c0, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d59da8a-c0, col_values=(('external_ids', {'iface-id': '9d59da8a-c099-4245-b965-3f07c15d0088', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:90:ce', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:01 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0')
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60871186-c9, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60871186-c9, col_values=(('external_ids', {'iface-id': '60871186-c933-413b-be74-a261061e4437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:fb:5e', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-a5b2f050-5e59-4fdb-acd3-911a0c2ade2b req-5884b906-ca36-4b0d-8110-e5eccfcd24b7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a5b2f050-5e59-4fdb-acd3-911a0c2ade2b req-5884b906-ca36-4b0d-8110-e5eccfcd24b7 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a5b2f050-5e59-4fdb-acd3-911a0c2ade2b req-5884b906-ca36-4b0d-8110-e5eccfcd24b7 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a5b2f050-5e59-4fdb-acd3-911a0c2ade2b req-5884b906-ca36-4b0d-8110-e5eccfcd24b7 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-a5b2f050-5e59-4fdb-acd3-911a0c2ade2b req-5884b906-ca36-4b0d-8110-e5eccfcd24b7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:01 user nova-compute[70594]: WARNING nova.compute.manager [req-a5b2f050-5e59-4fdb-acd3-911a0c2ade2b req-5884b906-ca36-4b0d-8110-e5eccfcd24b7 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c for instance with vm_state building and task_state spawning.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] No VIF found with MAC fa:16:3e:b0:5a:95, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:01 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9')
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:01 user nova-compute[70594]: INFO nova.compute.manager [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Took 35.04 seconds to build instance.
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3d7ba1-81, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b3d7ba1-81, col_values=(('external_ids', {'iface-id': '1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:5a:8d', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1debcb8f-05ef-4037-a381-5efdc5a66457 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.137s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81')
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b00967a-2f, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b00967a-2f, col_values=(('external_ids', {'iface-id': '8b00967a-2f00-4507-9a9a-e40bb2a0cdeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:38:20', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f')
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-changed-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Refreshing instance network info cache due to event network-changed-6e9ea0b8-0c26-439c-a81b-c522f8285930. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] Acquiring lock "refresh_cache-afa7d3a7-f79f-4914-a78d-a77b093d1cb1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] Acquired lock "refresh_cache-afa7d3a7-f79f-4914-a78d-a77b093d1cb1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Refreshing network info cache for port 6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap785fc53b-ec, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap785fc53b-ec, col_values=(('external_ids', {'iface-id': '785fc53b-ec01-487e-a17f-c30e6af84840', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:00:6d', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:01 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec')
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:01 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a80119-22, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4a80119-22, col_values=(('external_ids', {'iface-id': 'f4a80119-224e-427e-93e8-afbb621d7b07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ea:51', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:02 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22')
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8babdc9b-f9, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8babdc9b-f9, col_values=(('external_ids', {'iface-id': '8babdc9b-f953-4d18-b754-8355b0dd3109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:21:10', 'vm-uuid': '58bf4d75-dfda-4ba8-91bd-5afb2a20ef35'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:02 user nova-compute[70594]: INFO os_vif [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9')
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] No BDM found with device name hda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] No VIF found with MAC fa:16:3e:4f:90:ce, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] No VIF found with MAC fa:16:3e:79:00:6d, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:02 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Using config drive
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Updated VIF entry in instance network info cache for port 6e9ea0b8-0c26-439c-a81b-c522f8285930. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Updating instance_info_cache with network_info: [{"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84a66e9a-cb4d-4f93-b341-93577e6c8b99 req-fe432217-2ec2-4408-8351-70988ac4c4e3 service nova] Releasing lock "refresh_cache-afa7d3a7-f79f-4914-a78d-a77b093d1cb1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:02 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Creating config drive at /opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35/disk.config
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptbondc0j {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptbondc0j" returned: 0 in 0.051s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance destroyed successfully.
Jul 26 17:00:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Attempting rescue
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70594) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:00:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Creating image(s)
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'trusted_certs' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.170s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue" returned: 0 in 0.050s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'migration_context' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Start _get_guest_xml network_info=[{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:86:39:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'resources' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'numa_topology' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:03 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:00:03 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'vcpu_model' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461824633',display_name='tempest-ServerRescueNegativeTestJSON-server-1461824633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461824633',id=4,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-mqt5vmwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:33Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=e88c0cbb-b2f5-4e81-817d-9dcc23b1c827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:86:39:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:86:39:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'pci_devices' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:00:03 user nova-compute[70594]:   <uuid>e88c0cbb-b2f5-4e81-817d-9dcc23b1c827</uuid>
Jul 26 17:00:03 user nova-compute[70594]:   <name>instance-00000004</name>
Jul 26 17:00:03 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:00:03 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:00:03 user nova-compute[70594]:   <metadata>
Jul 26 17:00:03 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:00:03 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:00:03 user nova-compute[70594]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1461824633</nova:name>
Jul 26 17:00:03 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:00:03</nova:creationTime>
Jul 26 17:00:03 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:00:03 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:00:03 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:00:03 user nova-compute[70594]:       <nova:owner>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:user uuid="f5f5bd39056d4ebc973b6d8571a796ab">tempest-ServerRescueNegativeTestJSON-159727237-project-member</nova:user>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:project uuid="a2349e37642f4f4d9a3fe7b2c3d7a6c7">tempest-ServerRescueNegativeTestJSON-159727237</nova:project>
Jul 26 17:00:03 user nova-compute[70594]:       </nova:owner>
Jul 26 17:00:03 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:00:03 user nova-compute[70594]:       <nova:ports>
Jul 26 17:00:03 user nova-compute[70594]:         <nova:port uuid="b69a082e-0149-47b1-beef-e2a3b1351c73">
Jul 26 17:00:03 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 26 17:00:03 user nova-compute[70594]:         </nova:port>
Jul 26 17:00:03 user nova-compute[70594]:       </nova:ports>
Jul 26 17:00:03 user nova-compute[70594]:     </nova:instance>
Jul 26 17:00:03 user nova-compute[70594]:   </metadata>
Jul 26 17:00:03 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:00:03 user nova-compute[70594]:     <system>
Jul 26 17:00:03 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:00:03 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:00:03 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:00:03 user nova-compute[70594]:       <entry name="serial">e88c0cbb-b2f5-4e81-817d-9dcc23b1c827</entry>
Jul 26 17:00:03 user nova-compute[70594]:       <entry name="uuid">e88c0cbb-b2f5-4e81-817d-9dcc23b1c827</entry>
Jul 26 17:00:03 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:00:03 user nova-compute[70594]:     </system>
Jul 26 17:00:03 user nova-compute[70594]:   </sysinfo>
Jul 26 17:00:03 user nova-compute[70594]:   <os>
Jul 26 17:00:03 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:00:03 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:00:03 user nova-compute[70594]:   </os>
Jul 26 17:00:03 user nova-compute[70594]:   <features>
Jul 26 17:00:03 user nova-compute[70594]:     <acpi/>
Jul 26 17:00:03 user nova-compute[70594]:     <apic/>
Jul 26 17:00:03 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:00:03 user nova-compute[70594]:   </features>
Jul 26 17:00:03 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:00:03 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:00:03 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:00:03 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:00:03 user nova-compute[70594]:   </clock>
Jul 26 17:00:03 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:00:03 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:00:03 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:00:03 user nova-compute[70594]:   </cpu>
Jul 26 17:00:03 user nova-compute[70594]:   <devices>
Jul 26 17:00:03 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:00:03 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:00:03 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue"/>
Jul 26 17:00:03 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:00:03 user nova-compute[70594]:     </disk>
Jul 26 17:00:03 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:00:03 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:00:03 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk"/>
Jul 26 17:00:03 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:00:03 user nova-compute[70594]:     </disk>
Jul 26 17:00:03 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:00:03 user nova-compute[70594]:       <mac address="fa:16:3e:86:39:e7"/>
Jul 26 17:00:03 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:03 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:00:03 user nova-compute[70594]:       <target dev="tapb69a082e-01"/>
Jul 26 17:00:03 user nova-compute[70594]:     </interface>
Jul 26 17:00:03 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:00:03 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/console.log" append="off"/>
Jul 26 17:00:03 user nova-compute[70594]:     </serial>
Jul 26 17:00:03 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:00:03 user nova-compute[70594]:     <video>
Jul 26 17:00:03 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:00:03 user nova-compute[70594]:     </video>
Jul 26 17:00:03 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:00:03 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:00:03 user nova-compute[70594]:     </rng>
Jul 26 17:00:03 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:00:03 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:00:03 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:00:03 user nova-compute[70594]:     </memballoon>
Jul 26 17:00:03 user nova-compute[70594]:   </devices>
Jul 26 17:00:03 user nova-compute[70594]: </domain>
Jul 26 17:00:03 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:00:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance destroyed successfully.
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-unplugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-unplugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:03 user nova-compute[70594]: WARNING nova.compute.manager [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-unplugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state active and task_state rescuing.
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:03 user nova-compute[70594]: WARNING nova.compute.manager [req-12fe7235-5148-4b75-a3f1-d778fe2bb86e req-3aa3d155-d865-408c-8287-8ad1956451bc service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state active and task_state rescuing.
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing instance network info cache due to event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:86:39:e7, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390808.7956395, afa7d3a7-f79f-4914-a78d-a77b093d1cb1 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] VM Resumed (Lifecycle Event)
Jul 26 17:00:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-changed-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Refreshing instance network info cache due to event network-changed-87faecb4-e13b-455f-911b-2c9f9e614336. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.network.neutron [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Refreshing network info cache for port 87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-f213c886-bbcd-4222-a14b-3134d3ba8e83 req-d703bdb3-107d-4cbc-929d-500a63659849 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f213c886-bbcd-4222-a14b-3134d3ba8e83 req-d703bdb3-107d-4cbc-929d-500a63659849 service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f213c886-bbcd-4222-a14b-3134d3ba8e83 req-d703bdb3-107d-4cbc-929d-500a63659849 service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f213c886-bbcd-4222-a14b-3134d3ba8e83 req-d703bdb3-107d-4cbc-929d-500a63659849 service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-f213c886-bbcd-4222-a14b-3134d3ba8e83 req-d703bdb3-107d-4cbc-929d-500a63659849 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-f213c886-bbcd-4222-a14b-3134d3ba8e83 req-d703bdb3-107d-4cbc-929d-500a63659849 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state active and task_state rescuing.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-7ffc12bf-aef3-4596-a3c9-4a6673f1dd0f req-6583f88a-5a2d-41cf-b21b-fa1ea47c7138 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7ffc12bf-aef3-4596-a3c9-4a6673f1dd0f req-6583f88a-5a2d-41cf-b21b-fa1ea47c7138 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7ffc12bf-aef3-4596-a3c9-4a6673f1dd0f req-6583f88a-5a2d-41cf-b21b-fa1ea47c7138 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7ffc12bf-aef3-4596-a3c9-4a6673f1dd0f req-6583f88a-5a2d-41cf-b21b-fa1ea47c7138 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-7ffc12bf-aef3-4596-a3c9-4a6673f1dd0f req-6583f88a-5a2d-41cf-b21b-fa1ea47c7138 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-7ffc12bf-aef3-4596-a3c9-4a6673f1dd0f req-6583f88a-5a2d-41cf-b21b-fa1ea47c7138 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-60871186-c933-413b-be74-a261061e4437 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-27badbaf-c1a9-49bc-a9c6-57d1a86d1735 req-04a700ee-a78e-442c-ac20-319a2c1ae12b service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-60871186-c933-413b-be74-a261061e4437 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-bfa1e748-3189-41db-9e56-bdd873e8ca7e req-77c08e14-688a-4a51-a6dd-e027c59e4dff service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bfa1e748-3189-41db-9e56-bdd873e8ca7e req-77c08e14-688a-4a51-a6dd-e027c59e4dff service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bfa1e748-3189-41db-9e56-bdd873e8ca7e req-77c08e14-688a-4a51-a6dd-e027c59e4dff service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bfa1e748-3189-41db-9e56-bdd873e8ca7e req-77c08e14-688a-4a51-a6dd-e027c59e4dff service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-bfa1e748-3189-41db-9e56-bdd873e8ca7e req-77c08e14-688a-4a51-a6dd-e027c59e4dff service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-bfa1e748-3189-41db-9e56-bdd873e8ca7e req-77c08e14-688a-4a51-a6dd-e027c59e4dff service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state active and task_state rescuing.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-17cb2747-cea2-4b84-9826-36a19a08dbf1 req-f9c9be60-bb0b-42e5-bd2a-1289196696c0 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.compute.manager [req-cb3812a1-4cb0-4f48-938e-22dd6f4b6882 req-48249ebf-0d6c-41f9-8781-4336ed66f168 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 for instance with vm_state building and task_state spawning.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-32b173b2-ea7a-493f-96e2-96488e960bbf tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozXSWULR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:11 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:00:11 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=6578MB free_disk=25.680099487304688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.007s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Instance spawned successfully.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390808.7959282, afa7d3a7-f79f-4914-a78d-a77b093d1cb1 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] VM Started (Lifecycle Event)
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260" returned: 21 in 0.068s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2b789-5660-45ff-a96c-8e72a4118010]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:00:11 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.067s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf48a5-bd79-42e3-bb83-7bf2fc8658a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf] added
Jul 26 17:00:11 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3061a77-356e-485a-a411-0f8217665c95]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390810.6456852, e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] VM Resumed (Lifecycle Event)
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5940b4-0c0c-40cc-92d8-26b16847f75f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozXSWULR {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Took 12.37 seconds to spawn the instance on the hypervisor.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e28e16e1-92fb-48c9-9763-249ae2f1d906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f113b65d-efa3-4f64-aec7-37f14c97a020 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 2c9162fc-40f6-462c-843a-fa279515db41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e6902f86-dd2f-47d5-b48b-b63b014eeb9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9b095024-0bcf-4aa9-818f-24b0efaba6c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance afa7d3a7-f79f-4914-a78d-a77b093d1cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozXSWULR" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e9016-3cc7-4e8e-8e12-44a1480e08c5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozXSWULR'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce219f-21cb-465d-8f47-aa5687f7b814]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] instance snapshotting
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390810.6527095, e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] VM Started (Lifecycle Event)
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.network.neutron [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updated VIF entry in instance network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.network.neutron [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[366260c1-a7f2-4803-97c2-289ff65ba4ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-daadc45e-f93b-4ce2-9d55-e465e196f0ba req-4cd4cfc0-a358-4b9f-9833-0a23192eb793 service nova] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:11 user nova-compute[70594]: INFO nova.compute.manager [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Took 13.61 seconds to build instance.
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-27cab679-a4eb-448b-8518-7fd253cd2d0d tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.725s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4b52e3-ae27-45d0-9d66-34003c686759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260]
Jul 26 17:00:11 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:11 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dededf0-eadf-4ffc-b0de-b96764a089d9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d6368e-c8c3-4afe-987f-e9bddf9e5729]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf (non-flash)
Jul 26 17:00:11 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:11 user nova-compute[70594]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf (non-flash)
Jul 26 17:00:11 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.624s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:00:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d40f47d-72d8-401e-98d2-c456ee7a832a]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozXSWULR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Beginning live snapshot process
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390812.0944588, 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] VM Resumed (Lifecycle Event)
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance spawned successfully.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390812.0968626, 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] VM Started (Lifecycle Event)
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:12 user nova-compute[70594]: WARNING nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 for instance with vm_state building and task_state spawning.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:12 user nova-compute[70594]: WARNING nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 for instance with vm_state building and task_state spawning.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-changed-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing instance network info cache due to event network-changed-58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Took 15.67 seconds to spawn the instance on the hypervisor.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:00:12 user nova-compute[70594]: INFO nova.compute.manager [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Took 37.91 seconds to build instance.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-137f3e1c-3e77-436a-bf13-611604031c25 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.059s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.378s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updated VIF entry in instance network info cache for port 87faecb4-e13b-455f-911b-2c9f9e614336. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] No waiting events found dispatching network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:12 user nova-compute[70594]: WARNING nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received unexpected event network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 for instance with vm_state building and task_state spawning.
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] No waiting events found dispatching network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:12 user nova-compute[70594]: WARNING nova.compute.manager [req-5b8326ff-e4a8-461c-90d4-ddb0397f3732 req-b0fa3b76-f6d5-4540-91ae-007ca0a3e773 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received unexpected event network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 for instance with vm_state building and task_state spawning.
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.182s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpttd3l7p9/37a3b4b6b1de493abea63525e5dbe064.delta 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.717s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] <== connect_volume: return (1720ms) {'type': 'block', 'scsi_wwn': '23838396130383830', 'path': '/dev/sdh'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838396130383830', 'path': '/dev/sdh'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpttd3l7p9/37a3b4b6b1de493abea63525e5dbe064.delta 1073741824" returned: 0 in 0.059s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70594) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 26 17:00:13 user nova-compute[70594]: INFO nova.virt.libvirt.host [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] UEFI support detected
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lazy-loading 'flavor' on Instance uuid e28e16e1-92fb-48c9-9763-249ae2f1d906 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updated VIF entry in instance network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:00:13 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:13 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:00:13 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:00:13 user nova-compute[70594]:   <serial>24222b62-0759-4fd7-87b6-daf3174aefdf</serial>
Jul 26 17:00:13 user nova-compute[70594]: </disk>
Jul 26 17:00:13 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:13 user nova-compute[70594]: WARNING nova.compute.manager [req-3d4ab247-4172-4a99-b918-254e821e9f39 req-52ecd788-503c-431a-bd16-cc63553f068d service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 for instance with vm_state building and task_state spawning.
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] No VIF found with MAC fa:16:3e:06:b8:bc, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65d9f0f-8885-4077-bd4b-d37225d28347 tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.978s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:00:14 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 26 17:00:14 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:00:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpttd3l7p9/37a3b4b6b1de493abea63525e5dbe064.delta /opt/stack/data/nova/instances/snapshots/tmpttd3l7p9/37a3b4b6b1de493abea63525e5dbe064 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:15 user nova-compute[70594]: INFO nova.compute.manager [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Terminating instance
Jul 26 17:00:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpttd3l7p9/37a3b4b6b1de493abea63525e5dbe064.delta /opt/stack/data/nova/instances/snapshots/tmpttd3l7p9/37a3b4b6b1de493abea63525e5dbe064" returned: 0 in 0.813s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:15 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Snapshot extracted, beginning image upload
Jul 26 17:00:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-a762b0c0-5372-4891-bb9d-cc9f2c537117 req-7ccca6d6-97d7-438d-bd75-40c10afe199e service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-vif-unplugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a762b0c0-5372-4891-bb9d-cc9f2c537117 req-7ccca6d6-97d7-438d-bd75-40c10afe199e service nova] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a762b0c0-5372-4891-bb9d-cc9f2c537117 req-7ccca6d6-97d7-438d-bd75-40c10afe199e service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a762b0c0-5372-4891-bb9d-cc9f2c537117 req-7ccca6d6-97d7-438d-bd75-40c10afe199e service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-a762b0c0-5372-4891-bb9d-cc9f2c537117 req-7ccca6d6-97d7-438d-bd75-40c10afe199e service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] No waiting events found dispatching network-vif-unplugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-a762b0c0-5372-4891-bb9d-cc9f2c537117 req-7ccca6d6-97d7-438d-bd75-40c10afe199e service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-vif-unplugged-09283b93-514b-489a-895b-c2864079e40e for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Instance destroyed successfully.
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lazy-loading 'resources' on Instance uuid e28e16e1-92fb-48c9-9763-249ae2f1d906 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1399289597',display_name='tempest-DeleteServersTestJSON-server-1399289597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1399289597',id=1,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4a12260d9e34ee2b6154a9f4f3281b9',ramdisk_id='',reservation_id='r-7l19n7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1821837487',owner_user_name='tempest-DeleteServersTestJSON-1821837487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T16:58:23Z,user_data=None,user_id='87ac9d550cb04cbd972aacae0a4af674',uuid=e28e16e1-92fb-48c9-9763-249ae2f1d906,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Converting VIF {"id": "09283b93-514b-489a-895b-c2864079e40e", "address": "fa:16:3e:06:b8:bc", "network": {"id": "929a8f27-854a-4d88-9f93-58d3f9f8879b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-336990242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4a12260d9e34ee2b6154a9f4f3281b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09283b93-51", "ovs_interfaceid": "09283b93-514b-489a-895b-c2864079e40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_vif [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09283b93-51, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:16 user nova-compute[70594]: INFO os_vif [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b8:bc,bridge_name='br-int',has_traffic_filtering=True,id=09283b93-514b-489a-895b-c2864079e40e,network=Network(929a8f27-854a-4d88-9f93-58d3f9f8879b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09283b93-51')
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozXSWULR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:16 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6ab7f-a84b-4736-a290-630ceffaeb86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:00:16 user nova-compute[70594]: No targets found.
Jul 26 17:00:16 user nova-compute[70594]: iSNS:
Jul 26 17:00:16 user nova-compute[70594]: No targets found.
Jul 26 17:00:16 user nova-compute[70594]: STATIC:
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf
Jul 26 17:00:16 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:16 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:16 user nova-compute[70594]: FIRMWARE:
Jul 26 17:00:16 user nova-compute[70594]: No targets found.
Jul 26 17:00:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:00:16 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:00:16 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[804854f2-b162-40cf-aacb-7c55d0e4c9c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4763e51-31a0-454c-a723-5f10d740725c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf (non-flash)
Jul 26 17:00:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:16 user nova-compute[70594]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf (non-flash)
Jul 26 17:00:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910654040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf'): ({'sdh'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Removing single pathed devices sdh {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf04b03-fc29-425e-991d-bf0852e09552]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c47e83d-2b95-4f35-8ca4-722c4ff0f611]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Flushing IO for device /dev/sdh {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddc2d77-1d29-4962-a2a7-c1f61ee1fe7e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f209f-35ef-4060-8323-4d081faa0638]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a5b33b-3b4e-48aa-adf5-3de313ea7e38]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:16 user nova-compute[70594]: INFO nova.compute.manager [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Shelving
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadc5d7-36d5-42af-b01d-0ca650d6d7dc]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260]
Jul 26 17:00:16 user nova-compute[70594]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24222b62-0759-4fd7-87b6-daf3174aefdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51e25f-5a5f-4a64-b18c-e49ac8f4ab85]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] <== disconnect_volume: return (424ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:00:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Deleting instance files /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906_del
Jul 26 17:00:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Deletion of /opt/stack/data/nova/instances/e28e16e1-92fb-48c9-9763-249ae2f1d906_del complete
Jul 26 17:00:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:17 user nova-compute[70594]: INFO nova.compute.manager [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Took 1.73 seconds to destroy the instance on the hypervisor.
Jul 26 17:00:17 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:00:17 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:00:17 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:00:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance destroyed successfully.
Jul 26 17:00:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Beginning cold snapshot process
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk /opt/stack/data/nova/instances/snapshots/tmpqecae89q/079d6060471548b3879ed493077a2658 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Acquiring lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] No waiting events found dispatching network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:18 user nova-compute[70594]: WARNING nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received unexpected event network-vif-plugged-09283b93-514b-489a-895b-c2864079e40e for instance with vm_state active and task_state deleting.
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-unplugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-unplugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:18 user nova-compute[70594]: WARNING nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-unplugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:18 user nova-compute[70594]: WARNING nova.compute.manager [req-d4b6016f-8b60-4761-8eaf-e8ab3d98d39c req-e7aa9de8-9354-4ec7-85fc-0f2963d5bdd7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-296d70fb-9599-4822-933c-03c9ed6687ad req-1d4c3c82-cb92-4122-81a6-50852b974d5f service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Received event network-vif-deleted-09283b93-514b-489a-895b-c2864079e40e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:18 user nova-compute[70594]: INFO nova.compute.manager [req-296d70fb-9599-4822-933c-03c9ed6687ad req-1d4c3c82-cb92-4122-81a6-50852b974d5f service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Neutron deleted interface 09283b93-514b-489a-895b-c2864079e40e; detaching it from the instance and deleting it from the info cache
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-296d70fb-9599-4822-933c-03c9ed6687ad req-1d4c3c82-cb92-4122-81a6-50852b974d5f service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:18 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Took 1.00 seconds to deallocate network for instance.
Jul 26 17:00:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-296d70fb-9599-4822-933c-03c9ed6687ad req-1d4c3c82-cb92-4122-81a6-50852b974d5f service nova] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Detach interface failed, port_id=09283b93-514b-489a-895b-c2864079e40e, reason: Instance e28e16e1-92fb-48c9-9763-249ae2f1d906 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:00:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk /opt/stack/data/nova/instances/snapshots/tmpqecae89q/079d6060471548b3879ed493077a2658" returned: 0 in 0.547s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Snapshot extracted, beginning image upload
Jul 26 17:00:19 user nova-compute[70594]: INFO nova.compute.manager [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Took 1.08 seconds to detach 1 volumes for instance.
Jul 26 17:00:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Snapshot image upload complete
Jul 26 17:00:19 user nova-compute[70594]: INFO nova.compute.manager [None req-bcfe9d95-0d17-45c5-91f7-b9514afabc02 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Took 7.77 seconds to snapshot the instance on the hypervisor.
Jul 26 17:00:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:00:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:00:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:19 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Deleted allocations for instance e28e16e1-92fb-48c9-9763-249ae2f1d906
Jul 26 17:00:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ccd2bf60-551b-425e-b931-5fd2f8a07b9d tempest-DeleteServersTestJSON-1821837487 tempest-DeleteServersTestJSON-1821837487-project-member] Lock "e28e16e1-92fb-48c9-9763-249ae2f1d906" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.038s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Snapshot image upload complete
Jul 26 17:00:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:22 user nova-compute[70594]: INFO nova.compute.manager [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Shelve offloading
Jul 26 17:00:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance destroyed successfully.
Jul 26 17:00:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:00:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance destroyed successfully.
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'resources' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-932025414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-932025414',id=7,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/w6WOcQhiqS/3FyZmC4OK2c81YiTIVV6Ahj8uL8bOuqIQ2MwKz77Pp39C0RXj21WTnTmR/EVR7Hm439n7sCQbqXBnQ1TWgTDTl3x8OEKtFMjNb+lQxSaHpnqgo64OmWQ==',key_name='tempest-keypair-1077150454',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-2sdwm5fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member',shelved_at='2023-07-26T17:00:22.738638',shelved_host='user',shelved_image_id='f5276db9-43a1-4fd5-a06b-bec113e04585'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=ae56085e-6a66-494f-9ec0-2397ec7eb4b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG os_vif [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58242289-8f, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:24 user nova-compute[70594]: INFO os_vif [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f')
Jul 26 17:00:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Deleting instance files /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0_del
Jul 26 17:00:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Deletion of /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0_del complete
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-changed-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing instance network info cache due to event network-changed-58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:24 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Deleted allocations for instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0
Jul 26 17:00:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG nova.objects.instance [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'numa_topology' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updated VIF entry in instance network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap58242289-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b08c5267-84a4-4ef8-a2f2-4f096d9d4292 req-48dfa4f0-a1d5-4d61-873d-66d7c02a95b6 service nova] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-586e6c33-b7a7-453b-ab26-802b38c7fa08 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.675s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-changed-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Refreshing instance network info cache due to event network-changed-8ffc9433-9916-402e-b773-65c952436767. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] Acquiring lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] Acquired lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:29 user nova-compute[70594]: DEBUG nova.network.neutron [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Refreshing network info cache for port 8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updated VIF entry in instance network info cache for port 8ffc9433-9916-402e-b773-65c952436767. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updating instance_info_cache with network_info: [{"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-97262ef6-132f-4a7a-a0fe-5d21bae34db6 req-d61f412c-2076-442d-b559-94b5c539930d service nova] Releasing lock "refresh_cache-f113b65d-efa3-4f64-aec7-37f14c97a020" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:31 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390816.374823, e28e16e1-92fb-48c9-9763-249ae2f1d906 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:31 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] VM Stopped (Lifecycle Event)
Jul 26 17:00:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-55f0ee74-3ab1-4df0-b1c6-c5dbf10749b7 None None] [instance: e28e16e1-92fb-48c9-9763-249ae2f1d906] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:32 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390817.653374, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:32 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] VM Stopped (Lifecycle Event)
Jul 26 17:00:32 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bd3a014a-ed10-4707-94e7-47ac032dc116 None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-changed-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Refreshing instance network info cache due to event network-changed-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] Acquiring lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] Acquired lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:32 user nova-compute[70594]: DEBUG nova.network.neutron [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Refreshing network info cache for port 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lazy-loading 'flavor' on Instance uuid f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updated VIF entry in instance network info cache for port 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updating instance_info_cache with network_info: [{"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c7e5718f-bb9d-4b6f-a52d-87235062af2b req-2563a359-0dce-4e03-b1bd-b93a050abf62 service nova] Releasing lock "refresh_cache-a94a2105-0e19-4d03-bea8-f9e44b6d7f79" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:33 user nova-compute[70594]: INFO nova.compute.manager [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Attaching volume d17e6b32-834e-40fc-844f-9dcb7a92d139 to /dev/sdc
Jul 26 17:00:33 user nova-compute[70594]: DEBUG os_brick.utils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d0f9a2-b986-451a-9bff-ff973d3ddedf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c037819e-d6f4-426d-a119-8bbf6baec0ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[574bfb46-c461-48b5-a927-a551e2ebf0e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f795dd6b-ee42-4b79-9654-f89a1f367dc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:33 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:00:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb81bb8b-2fff-4f1d-93fd-8ac8da1c4c3c]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG os_brick.utils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:33 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updating existing volume attachment record: d8245ae6-8438-4b48-8b89-939f543f8fbd {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:00:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG nova.objects.instance [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'flavor' on Instance uuid a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:36 user nova-compute[70594]: INFO nova.compute.manager [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Attaching volume 063daa2b-e8ce-452d-8624-2880c748ca81 to /dev/vdb
Jul 26 17:00:36 user nova-compute[70594]: DEBUG os_brick.utils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[067b77f7-d9a3-4256-ac0f-1a0c3a72c8a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9ad659-eebf-4ab4-a8cc-356deb2adf55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c87454-0b0f-4571-b25f-13fc86c0876d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb0909-f5e6-4102-ba1e-8a831dc536cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-changed-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Refreshing instance network info cache due to event network-changed-f81cc8f4-fa56-4da2-994b-31b53dc46242. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] Acquiring lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] Acquired lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Refreshing network info cache for port f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:37 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e5752b-a225-4c74-b5e2-0616f485fed9]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.utils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updating existing volume attachment record: 1ec487ac-269a-41c4-84e4-dde3b1e10f9b {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.objects.instance [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lazy-loading 'flavor' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:37 user nova-compute[70594]: INFO nova.compute.manager [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Attaching volume 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 to /dev/vdb
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updated VIF entry in instance network info cache for port f81cc8f4-fa56-4da2-994b-31b53dc46242. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updating instance_info_cache with network_info: [{"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-86dcda0d-f0b9-4082-ae89-f7dc12d25472 req-4724d71b-8dfe-4e62-8580-e23bd8e105d9 service nova] Releasing lock "refresh_cache-2c9162fc-40f6-462c-843a-fa279515db41" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.utils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce8ae4-db8f-47a4-9941-2403a411db20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55859ac-11f3-4e8f-9340-3e25d192c1a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac50f2-8579-4fd0-9248-7d756aa7a7ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe982c2c-81b7-47b9-a0f1-35d4e3d5e60f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:37 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:00:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f25f4b-a5cc-499e-ad75-dbf42b6b30b6]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG os_brick.utils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:37 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updating existing volume attachment record: 3c1ea3e1-504f-4b89-8e9a-a7f9d886758c {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:00:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeryHmQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:41 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:41 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:41 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc597d17-0f99-409c-b538-5dc651f33974]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:00:41 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[95475400-0eb3-4570-a632-29e8ac4a549e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139] added
Jul 26 17:00:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e3c7bb-5cea-4f69-86e4-17f9a7da4a4e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[100af907-2202-40d3-ad20-8a3de2f590a9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeryHmQf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeryHmQf" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a81078-629c-4958-a780-b069ec96f18a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WeryHmQf'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393b9a8-eb03-43e2-9776-f96287405b1c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9f16f-d194-4dce-8d9b-77c45a69c750]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0ecc81-d4a5-4495-93f2-e41c472d9640]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260]
Jul 26 17:00:41 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db237aa-418d-4626-8eda-c2e2ed8442b1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b0fb1-7865-4486-a362-c1469decf8fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:41 user nova-compute[70594]: INFO nova.compute.manager [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Terminating instance
Jul 26 17:00:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9dd797-f081-4f05-adb0-cbdec58546c1]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeryHmQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-a974bdb0-088e-4338-932d-9f138baa5eba req-d935882f-ecd3-4159-8e5b-6d78954856d4 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-vif-unplugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a974bdb0-088e-4338-932d-9f138baa5eba req-d935882f-ecd3-4159-8e5b-6d78954856d4 service nova] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a974bdb0-088e-4338-932d-9f138baa5eba req-d935882f-ecd3-4159-8e5b-6d78954856d4 service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a974bdb0-088e-4338-932d-9f138baa5eba req-d935882f-ecd3-4159-8e5b-6d78954856d4 service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-a974bdb0-088e-4338-932d-9f138baa5eba req-d935882f-ecd3-4159-8e5b-6d78954856d4 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] No waiting events found dispatching network-vif-unplugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-a974bdb0-088e-4338-932d-9f138baa5eba req-d935882f-ecd3-4159-8e5b-6d78954856d4 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-vif-unplugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:00:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Instance destroyed successfully.
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lazy-loading 'resources' on Instance uuid e6902f86-dd2f-47d5-b48b-b63b014eeb9b {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23736366238643333', 'path': '/dev/sdh'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366238643333', 'path': '/dev/sdh'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1119498941',display_name='tempest-VolumesNegativeTest-instance-1119498941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1119498941',id=11,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5c072ae6afb4206856e0be592087840',ramdisk_id='',reservation_id='r-xr7jpf3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-393978929',owner_user_name='tempest-VolumesNegativeTest-393978929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T16:59:03Z,user_data=None,user_id='e53b3525c5fc4e96b6e16e10ef5b05ef',uuid=e6902f86-dd2f-47d5-b48b-b63b014eeb9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Converting VIF {"id": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "address": "fa:16:3e:0f:e8:6f", "network": {"id": "b3204af2-1e7d-4d10-bfbc-c09eddec9f13", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d3cbf5335a224282b3b62a3bb9fd2dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ddedc0-d8", "ovs_interfaceid": "e5ddedc0-d8a2-4961-b86c-e9be2bb4470d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG os_vif [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5ddedc0-d8, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lazy-loading 'flavor' on Instance uuid f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:42 user nova-compute[70594]: INFO os_vif [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d,network=Network(b3204af2-1e7d-4d10-bfbc-c09eddec9f13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ddedc0-d8')
Jul 26 17:00:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Deleting instance files /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b_del
Jul 26 17:00:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Deletion of /opt/stack/data/nova/instances/e6902f86-dd2f-47d5-b48b-b63b014eeb9b_del complete
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:00:42 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:42 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:00:42 user nova-compute[70594]:   <target dev="sdc" bus="scsi"/>
Jul 26 17:00:42 user nova-compute[70594]:   <serial>d17e6b32-834e-40fc-844f-9dcb7a92d139</serial>
Jul 26 17:00:42 user nova-compute[70594]:   <address type="drive" controller="0" unit="2"/>
Jul 26 17:00:42 user nova-compute[70594]: </disk>
Jul 26 17:00:42 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:00:42 user nova-compute[70594]: INFO nova.compute.manager [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Took 1.13 seconds to destroy the instance on the hypervisor.
Jul 26 17:00:42 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:00:42 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No BDM found with device name sda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] No VIF found with MAC fa:16:3e:f3:13:3b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:43 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Took 0.52 seconds to deallocate network for instance.
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-4375b6e9-1673-414f-a59a-1efb3d64a155 req-9f481782-7c65-4c5c-8c0b-04f670acb4d2 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-vif-deleted-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:43 user nova-compute[70594]: INFO nova.compute.manager [req-4375b6e9-1673-414f-a59a-1efb3d64a155 req-9f481782-7c65-4c5c-8c0b-04f670acb4d2 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Neutron deleted interface e5ddedc0-d8a2-4961-b86c-e9be2bb4470d; detaching it from the instance and deleting it from the info cache
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.network.neutron [req-4375b6e9-1673-414f-a59a-1efb3d64a155 req-9f481782-7c65-4c5c-8c0b-04f670acb4d2 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-4375b6e9-1673-414f-a59a-1efb3d64a155 req-9f481782-7c65-4c5c-8c0b-04f670acb4d2 service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Detach interface failed, port_id=e5ddedc0-d8a2-4961-b86c-e9be2bb4470d, reason: Instance e6902f86-dd2f-47d5-b48b-b63b014eeb9b could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ea1599ac-3533-4bb7-833b-2512a6962721 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.589s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:00:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:43 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Deleted allocations for instance e6902f86-dd2f-47d5-b48b-b63b014eeb9b
Jul 26 17:00:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0680201c-a3b3-4083-8831-6c52e2a1c987 tempest-VolumesNegativeTest-393978929 tempest-VolumesNegativeTest-393978929-project-member] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:44 user nova-compute[70594]: INFO nova.compute.manager [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Detaching volume d17e6b32-834e-40fc-844f-9dcb7a92d139
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-03eec739-6c2f-4c82-b247-bd837f1a74e3 req-d54517cf-bd1c-4262-ba37-82a8bd3d966b service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received event network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-03eec739-6c2f-4c82-b247-bd837f1a74e3 req-d54517cf-bd1c-4262-ba37-82a8bd3d966b service nova] Acquiring lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-03eec739-6c2f-4c82-b247-bd837f1a74e3 req-d54517cf-bd1c-4262-ba37-82a8bd3d966b service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-03eec739-6c2f-4c82-b247-bd837f1a74e3 req-d54517cf-bd1c-4262-ba37-82a8bd3d966b service nova] Lock "e6902f86-dd2f-47d5-b48b-b63b014eeb9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-03eec739-6c2f-4c82-b247-bd837f1a74e3 req-d54517cf-bd1c-4262-ba37-82a8bd3d966b service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] No waiting events found dispatching network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:44 user nova-compute[70594]: WARNING nova.compute.manager [req-03eec739-6c2f-4c82-b247-bd837f1a74e3 req-d54517cf-bd1c-4262-ba37-82a8bd3d966b service nova] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Received unexpected event network-vif-plugged-e5ddedc0-d8a2-4961-b86c-e9be2bb4470d for instance with vm_state deleted and task_state None.
Jul 26 17:00:44 user nova-compute[70594]: INFO nova.virt.block_device [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Attempting to driver detach volume d17e6b32-834e-40fc-844f-9dcb7a92d139 from mountpoint /dev/sdc
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Attempting to detach device sdc from instance f113b65d-efa3-4f64-aec7-37f14c97a020 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:00:44 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:44 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:00:44 user nova-compute[70594]:   <target dev="sdc" bus="scsi"/>
Jul 26 17:00:44 user nova-compute[70594]:   <serial>d17e6b32-834e-40fc-844f-9dcb7a92d139</serial>
Jul 26 17:00:44 user nova-compute[70594]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 26 17:00:44 user nova-compute[70594]: </disk>
Jul 26 17:00:44 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:00:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Successfully detached device sdc from instance f113b65d-efa3-4f64-aec7-37f14c97a020 from the persistent domain config.
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f113b65d-efa3-4f64-aec7-37f14c97a020 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:00:44 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:44 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:00:44 user nova-compute[70594]:   <target dev="sdc" bus="scsi"/>
Jul 26 17:00:44 user nova-compute[70594]:   <serial>d17e6b32-834e-40fc-844f-9dcb7a92d139</serial>
Jul 26 17:00:44 user nova-compute[70594]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 26 17:00:44 user nova-compute[70594]: </disk>
Jul 26 17:00:44 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LczRIDJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:44 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:44 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:44 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[492824c2-0eca-437d-bd1d-ddb63e8842a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:00:44 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09804bb-4ecb-4e27-98b7-27e2934086ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81] added
Jul 26 17:00:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[21443b98-3cf5-421b-8283-8cd611e1d552]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690390844.5938315, f113b65d-efa3-4f64-aec7-37f14c97a020 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:00:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Successfully detached device sdc from instance f113b65d-efa3-4f64-aec7-37f14c97a020 from the live domain config.
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f34015-f490-4676-9ffc-b792ba1176ed]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeryHmQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:44 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LczRIDJx {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LczRIDJx" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a1110a-c19f-4c2f-87b7-02d0871b68a4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LczRIDJx'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3514ac42-b3cc-4870-a44b-6fa5d40dd47f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d033ecee-6e8f-4444-9548-eed4f5279d53]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f03a0b-5764-4fa1-9e65-55c8c7b525c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260]
Jul 26 17:00:44 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d969c-f2e6-4fbc-b25f-b2d08451dee4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47af0ed-0636-4f76-bcc8-cc9464ebb3cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f8293-9849-4938-874c-f534cdef591f]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LczRIDJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:45 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23032656635646537', 'path': '/dev/sdi'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032656635646537', 'path': '/dev/sdi'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.263s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG nova.objects.instance [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'flavor' on Instance uuid a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c444d8-dfda-4b2b-81e7-12689fb2b881]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:00:45 user nova-compute[70594]: No targets found.
Jul 26 17:00:45 user nova-compute[70594]: iSNS:
Jul 26 17:00:45 user nova-compute[70594]: No targets found.
Jul 26 17:00:45 user nova-compute[70594]: STATIC:
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:00:45 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:45 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:45 user nova-compute[70594]: FIRMWARE:
Jul 26 17:00:45 user nova-compute[70594]: No targets found.
Jul 26 17:00:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:00:45 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:00:45 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:00:45 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:45 user nova-compute[70594]:   <source dev="/dev/sdi"/>
Jul 26 17:00:45 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:00:45 user nova-compute[70594]:   <serial>063daa2b-e8ce-452d-8624-2880c748ca81</serial>
Jul 26 17:00:45 user nova-compute[70594]: </disk>
Jul 26 17:00:45 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3f05a-2946-4856-b18a-3ea28fc6b1eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d05b79-47de-461a-9bc6-f0e3141b5291]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 (non-flash)
Jul 26 17:00:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591db351b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139'): ({'sdh'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Removing single pathed devices sdh {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e0a68c-0819-4e89-94c6-b837cd51305c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[296ec519-44d4-4b2d-92d5-5d3836480a3e]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Flushing IO for device /dev/sdh {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c939f1ff-061b-473d-9585-31e7f32fe330]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad96c1-24d3-450d-8d76-f9366dd32dc8]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ae799-61b5-4371-b3a0-c9ebd0457bc7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa979dd-d76d-49ac-b087-de82524ac2ec]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260]
Jul 26 17:00:46 user nova-compute[70594]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d17e6b32-834e-40fc-844f-9dcb7a92d139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff35529f-66c7-439c-bb9a-49b0e851611a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] <== disconnect_volume: return (1615ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.081s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:46 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:46 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57e338-4204-413c-80b0-210ef8c271e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:00:46 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[db420256-02ad-4fac-9e23-0bcaa033dedf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19] added
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b4ae3-d1e6-488e-9d2c-94bc2cc3460e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3adfb3-e5ea-4e2c-9c70-b992a6e4ab1a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHMDLQWR {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No VIF found with MAC fa:16:3e:d7:48:38, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHMDLQWR" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc6993-43e0-4ebc-8b73-63e2e3aac195]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHMDLQWR'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f117d-ea27-4406-afbb-8d041c7dd006]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[764079b5-e664-47cd-8156-f1bebe97f1bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09ca4e3b-3f6a-4286-86f3-6291dbc531c5 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.576s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f0b7c-2a38-4a19-b128-00dfef590669]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]
Jul 26 17:00:46 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7c797-d30e-4a06-b9cb-3d7dc0e7e78a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf34c33-e5fc-4854-b274-27bea2cd7bc4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:46 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e647d5-6f42-4289-b288-1096d9eb846c]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lazy-loading 'flavor' on Instance uuid f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b8d7a3d3-550e-44b8-a908-9fc04af553a7 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.031s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:47 user nova-compute[70594]: INFO nova.compute.manager [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Detaching volume 063daa2b-e8ce-452d-8624-2880c748ca81
Jul 26 17:00:47 user nova-compute[70594]: INFO nova.virt.block_device [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Attempting to driver detach volume 063daa2b-e8ce-452d-8624-2880c748ca81 from mountpoint /dev/vdb
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Attempting to detach device vdb from instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:00:47 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:47 user nova-compute[70594]:   <source dev="/dev/sdi"/>
Jul 26 17:00:47 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:00:47 user nova-compute[70594]:   <serial>063daa2b-e8ce-452d-8624-2880c748ca81</serial>
Jul 26 17:00:47 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:00:47 user nova-compute[70594]: </disk>
Jul 26 17:00:47 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:00:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Successfully detached device vdb from instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 from the persistent domain config.
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:00:47 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:47 user nova-compute[70594]:   <source dev="/dev/sdi"/>
Jul 26 17:00:47 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:00:47 user nova-compute[70594]:   <serial>063daa2b-e8ce-452d-8624-2880c748ca81</serial>
Jul 26 17:00:47 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:00:47 user nova-compute[70594]: </disk>
Jul 26 17:00:47 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:47 user nova-compute[70594]: INFO nova.compute.manager [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Terminating instance
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] <== connect_volume: return (2454ms) {'type': 'block', 'scsi_wwn': '23964346162323063', 'path': '/dev/sdh'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964346162323063', 'path': '/dev/sdh'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lazy-loading 'flavor' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:00:47 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:00:47 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:00:47 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:00:47 user nova-compute[70594]:   <serial>9cde2fa9-c4c6-4a03-8977-cbde24dcaf19</serial>
Jul 26 17:00:47 user nova-compute[70594]: </disk>
Jul 26 17:00:47 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690390847.7975287, a94a2105-0e19-4d03-bea8-f9e44b6d7f79 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:00:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Successfully detached device vdb from instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 from the live domain config.
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LczRIDJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:47 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49e046-b5a9-4806-aa5e-164e8b4bc852]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:00:47 user nova-compute[70594]: No targets found.
Jul 26 17:00:47 user nova-compute[70594]: iSNS:
Jul 26 17:00:47 user nova-compute[70594]: No targets found.
Jul 26 17:00:47 user nova-compute[70594]: STATIC:
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:00:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:00:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:00:47 user nova-compute[70594]: FIRMWARE:
Jul 26 17:00:47 user nova-compute[70594]: No targets found.
Jul 26 17:00:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:00:47 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:00:47 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c22ad2-daa8-415a-a52b-27f017db6925]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da3578-b44f-4cc0-bfdf-cce4004723ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:47 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591068ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81'): ({'sdi'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Removing single pathed devices sdi {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-c7fba6e8-0c21-4061-a2f5-6a80535d1676 req-8991ba49-a610-4f23-b7d2-5e785548fa93 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-unplugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c7fba6e8-0c21-4061-a2f5-6a80535d1676 req-8991ba49-a610-4f23-b7d2-5e785548fa93 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c7fba6e8-0c21-4061-a2f5-6a80535d1676 req-8991ba49-a610-4f23-b7d2-5e785548fa93 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c7fba6e8-0c21-4061-a2f5-6a80535d1676 req-8991ba49-a610-4f23-b7d2-5e785548fa93 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-c7fba6e8-0c21-4061-a2f5-6a80535d1676 req-8991ba49-a610-4f23-b7d2-5e785548fa93 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-unplugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-c7fba6e8-0c21-4061-a2f5-6a80535d1676 req-8991ba49-a610-4f23-b7d2-5e785548fa93 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-unplugged-8ffc9433-9916-402e-b773-65c952436767 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac7b9b9-c190-446a-9eb5-6f14446086e4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[be85cbaf-ec21-4286-b9b9-189bed5f8c28]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Flushing IO for device /dev/sdi {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee7075-b452-4a9f-a8e4-a58d844cfef8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:00:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b18dc-1a86-4aa4-9497-e63b2a3fdd2a]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] SCSI volumes sdi have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3dead-4e93-4c8b-9122-d585d5485fa5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[157a3fcc-ec4b-4f6d-9453-557c3d8536fd]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260]
Jul 26 17:00:48 user nova-compute[70594]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:48 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:063daa2b-e8ce-452d-8624-2880c748ca81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ccdf9-cd68-42a2-97f4-8124f38f63ad]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] <== disconnect_volume: return (365ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Instance destroyed successfully.
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lazy-loading 'resources' on Instance uuid f113b65d-efa3-4f64-aec7-37f14c97a020 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1740148635',display_name='tempest-AttachSCSIVolumeTestJSON-server-1740148635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1740148635',id=8,image_ref='cf1b6fb9-ea14-40be-bc84-847328c544e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmctrsvc3pQ6J4mPa4wKGV1qY0SDli5JaKQa5GmXQsB9fnMxZkE0s1NyF7+wBqdqcK4YmDcDO/5kqw1S9+Pd159xlebO/YBTTlfylErHrlFUYGsyAqYZ813XIwFBRWUNg==',key_name='tempest-keypair-106241468',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4e093dc04d7404abbf947e0f0af0e6d',ramdisk_id='',reservation_id='r-zdydbg54',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf1b6fb9-ea14-40be-bc84-847328c544e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1764624525',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1764624525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T16:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729f4ca3575940bdbf8091263986aa1d',uuid=f113b65d-efa3-4f64-aec7-37f14c97a020,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Converting VIF {"id": "8ffc9433-9916-402e-b773-65c952436767", "address": "fa:16:3e:f3:13:3b", "network": {"id": "a8f7bd80-e2fd-4c06-820e-398ad8985d23", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1256943672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4e093dc04d7404abbf947e0f0af0e6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffc9433-99", "ovs_interfaceid": "8ffc9433-9916-402e-b773-65c952436767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG os_vif [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ffc9433-99, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:00:48 user nova-compute[70594]: INFO os_vif [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:13:3b,bridge_name='br-int',has_traffic_filtering=True,id=8ffc9433-9916-402e-b773-65c952436767,network=Network(a8f7bd80-e2fd-4c06-820e-398ad8985d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffc9433-99')
Jul 26 17:00:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Deleting instance files /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020_del
Jul 26 17:00:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Deletion of /opt/stack/data/nova/instances/f113b65d-efa3-4f64-aec7-37f14c97a020_del complete
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] No VIF found with MAC fa:16:3e:1f:9e:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:00:48 user nova-compute[70594]: INFO nova.compute.manager [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04a602a7-242a-46e3-be96-7438ead02a12 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.243s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:48 user nova-compute[70594]: DEBUG nova.objects.instance [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'flavor' on Instance uuid a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-09706ead-08d5-4c54-864d-c3a88ca041fe tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.747s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG os_brick.utils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:49 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Took 0.88 seconds to deallocate network for instance.
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-dd536858-4217-4e4a-b934-04c0b7903482 req-2e8fb978-2342-4f92-935c-6a44e00f0080 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-deleted-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:49 user nova-compute[70594]: INFO nova.compute.manager [req-dd536858-4217-4e4a-b934-04c0b7903482 req-2e8fb978-2342-4f92-935c-6a44e00f0080 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Neutron deleted interface 8ffc9433-9916-402e-b773-65c952436767; detaching it from the instance and deleting it from the info cache
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-dd536858-4217-4e4a-b934-04c0b7903482 req-2e8fb978-2342-4f92-935c-6a44e00f0080 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e51429-6f92-44f3-ba79-aaa66a4e8679]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-dd536858-4217-4e4a-b934-04c0b7903482 req-2e8fb978-2342-4f92-935c-6a44e00f0080 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Detach interface failed, port_id=8ffc9433-9916-402e-b773-65c952436767, reason: Instance f113b65d-efa3-4f64-aec7-37f14c97a020 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a0ae59-f426-4131-a120-87922470360f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec9f60-c41c-4e56-80d8-6b62ab433212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657b925-1957-45d1-94a0-6fdfc0b6a92b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:00:49 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ff7f21-11f1-497d-b90e-2ed71ce35c00]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG os_brick.utils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:49 user nova-compute[70594]: INFO nova.compute.manager [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Swapping volume 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 for 397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:50 user nova-compute[70594]: WARNING nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state deleted and task_state None.
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:50 user nova-compute[70594]: WARNING nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state deleted and task_state None.
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:50 user nova-compute[70594]: WARNING nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state deleted and task_state None.
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-unplugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-unplugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:50 user nova-compute[70594]: WARNING nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-unplugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state deleted and task_state None.
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Acquiring lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] No waiting events found dispatching network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:00:50 user nova-compute[70594]: WARNING nova.compute.manager [req-e64661fa-309b-455d-9f5c-0151fc8910cc req-c2f212a8-e41d-473a-88f2-00c9511ef055 service nova] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Received unexpected event network-vif-plugged-8ffc9433-9916-402e-b773-65c952436767 for instance with vm_state deleted and task_state None.
Jul 26 17:00:50 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Deleted allocations for instance f113b65d-efa3-4f64-aec7-37f14c97a020
Jul 26 17:00:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8bedec49-928a-4f70-a8a3-75adfc971f04 tempest-AttachSCSIVolumeTestJSON-1764624525 tempest-AttachSCSIVolumeTestJSON-1764624525-project-member] Lock "f113b65d-efa3-4f64-aec7-37f14c97a020" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PExyfOAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c9162fc-40f6-462c-843a-fa279515db41', 'attached_at': '', 'detached_at': '', 'volume_id': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'serial': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2c9162fc-40f6-462c-843a-fa279515db41', 'attached_at': '', 'detached_at': '', 'volume_id': '9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'serial'} {{(pid=70594) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PExyfOAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:00:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:00:56 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6ac41e-26af-4780-a97f-e4fec1b69028]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:00:56 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83199f15-29ba-4235-8c7d-2850befeb887]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f] added
Jul 26 17:00:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e19ddbd-ee3b-4a10-97ca-ee075ac95886]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[706082b1-c418-4f0e-8045-6853f11e788c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PExyfOAD {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PExyfOAD" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340c84b-e821-4b8f-b72c-1d1b9bf57073]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PExyfOAD'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[815034f7-6f6e-4567-96fe-b82770e12e0a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d854b89-99a4-474b-b317-0d5b06c1725a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da4308-ad65-4bb3-9927-09368c3d7548]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260]
Jul 26 17:00:57 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260] successful.
Jul 26 17:00:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9ee9e0-1942-41cb-9fe9-bae23d913c37]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aae915-e196-49a3-b31e-aa1652f1868e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:00:57 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:00:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc4a2e-b7da-4a94-9b15-4f720e1f204c]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390842.654174, e6902f86-dd2f-47d5-b48b-b63b014eeb9b => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:00:57 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] VM Stopped (Lifecycle Event)
Jul 26 17:00:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fe2f6f35-f8c3-4680-9fc0-1a19176f8557 None None] [instance: e6902f86-dd2f-47d5-b48b-b63b014eeb9b] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:00:57 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PExyfOAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23361656635383537', 'path': '/dev/sdi'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361656635383537', 'path': '/dev/sdi'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lazy-loading 'flavor' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:00:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 181403648 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:00:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 545259520 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 699400192 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 868220928 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:01:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=6919MB free_disk=25.642105102539062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:02 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 2c9162fc-40f6-462c-843a-fa279515db41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9b095024-0bcf-4aa9-818f-24b0efaba6c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance afa7d3a7-f79f-4914-a78d-a77b093d1cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbc9a8b-a60f-456c-b110-7e051048a77f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:02 user nova-compute[70594]: No targets found.
Jul 26 17:01:02 user nova-compute[70594]: iSNS:
Jul 26 17:01:02 user nova-compute[70594]: No targets found.
Jul 26 17:01:02 user nova-compute[70594]: STATIC:
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:02 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:02 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:02 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:02 user nova-compute[70594]: No targets found.
Jul 26 17:01:02 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:02 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:02 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a878bbb-d502-40f8-a6c4-3c2c2a457144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007b349-aeeb-4178-911b-21e529b047ec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:02 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:02 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910368700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19'): ({'sdh'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Removing single pathed devices sdh {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f066b61-008d-44a3-b60e-75a9401d3e8b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[963decaf-610d-4724-89ee-11b088948eb3]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Flushing IO for device /dev/sdh {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62280e-5569-4476-bb24-b34664298e8e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da47d986-bcd3-4416-a877-0937bcf85fbf]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6119f6e9-9d3a-4184-9cea-0556f56ced1c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.160s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[119b6933-e627-4563-a792-30a4bf3357f2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]
Jul 26 17:01:03 user nova-compute[70594]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:03 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[886abc17-361e-448a-8ba8-3ab6a5a1e785]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] <== disconnect_volume: return (426ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PExyfOAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '2c9162fc-40f6-462c-843a-fa279515db41', 'attached_at': '', 'detached_at': '', 'volume_id': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'serial'} {{(pid=70594) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] swap_volume: removing Cinder connection for volume 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 {{(pid=70594) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390848.482266, f113b65d-efa3-4f64-aec7-37f14c97a020 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:03 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] VM Stopped (Lifecycle Event)
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-99e9dba8-e0db-4553-9a74-44cacc84a92f None None] [instance: f113b65d-efa3-4f64-aec7-37f14c97a020] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] swap_volume: Updating volume 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PExyfOAD", "auth_password": "pK7PqChdvkDmW6", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f"}, "status": "reserved", "instance": "2c9162fc-40f6-462c-843a-fa279515db41", "attached_at": "", "detached_at": "", "volume_id": "397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f", "serial": "397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'no_device': None, 'attachment_id': '1e75f66e-e890-483d-95e8-103086e9a2e7'} {{(pid=70594) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 26 17:01:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8031251c-8cc1-481f-9633-2e688445f9de tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.498s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[022325f6-d7e9-4a44-acdd-0a5104483dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead37feb-ebed-43b1-89aa-ecddff182908]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd868b6-a3a5-4a10-8b6f-abcd48974dc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5122f0f-ee3f-43ea-9076-d867d515359d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:01:05 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:01:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b4e2e-2429-4cc4-af46-8cd1e600e6cc]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:01:05 user nova-compute[70594]: DEBUG os_brick.utils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:05 user nova-compute[70594]: INFO nova.compute.manager [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Swapping volume 397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f for 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19
Jul 26 17:01:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c9162fc-40f6-462c-843a-fa279515db41', 'attached_at': '', 'detached_at': '', 'volume_id': '9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'serial': '9cde2fa9-c4c6-4a03-8977-cbde24dcaf19'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PExyfOAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f'}, 'status': 'reserved', 'instance': '2c9162fc-40f6-462c-843a-fa279515db41', 'attached_at': '', 'detached_at': '', 'volume_id': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'serial'} {{(pid=70594) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:12 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:12 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:12 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d931b-ab47-4352-9963-97250d774bac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:01:12 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[972f601c-2c62-44cf-8ebc-74aae9a8e863]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19] added
Jul 26 17:01:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[909e98fc-be1c-4bbe-971f-882315291748]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a607c2-8b0e-4b72-9a80-9310e473e37b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHMDLQWR {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHMDLQWR" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[73be89c8-35dd-4e68-992a-f076fb31ee13]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHMDLQWR'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dca66aa-bc33-4d4d-927d-8f32d4d7d32f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f11e0-c8a1-4a3a-8cd7-2f1a68634622]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbf858-b8bd-4bd0-8f43-510b66247635]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]
Jul 26 17:01:12 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e6b4c-daf8-40a1-8ad3-b4cdc23a19f8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b45fef2-9506-46d7-9826-6c416b42be51]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:12 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f159244-72d8-4ee8-afd2-45c1bd6bf998]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:01:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:01:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23964346162323063', 'path': '/dev/sdh'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964346162323063', 'path': '/dev/sdh'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:01:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lazy-loading 'flavor' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 121634816 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 308281344 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 447741952 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 537919488 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 705691648 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PExyfOAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:17 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81c4b3-1676-4814-b2e2-1b777e444e53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:17 user nova-compute[70594]: No targets found.
Jul 26 17:01:17 user nova-compute[70594]: iSNS:
Jul 26 17:01:17 user nova-compute[70594]: No targets found.
Jul 26 17:01:17 user nova-compute[70594]: STATIC:
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:17 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:17 user nova-compute[70594]: No targets found.
Jul 26 17:01:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:17 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:17 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eeee9d-ba76-43e5-bd8d-4061d8f4d643]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca62dd3-62d2-40ae-bad7-bbb5d718fc80]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:17 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591830d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f'): ({'sdi'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Removing single pathed devices sdi {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[667b17ef-3056-4702-b279-674d5fd1fea6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021f851-f36d-4726-a202-3471e98a8ae1]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Flushing IO for device /dev/sdi {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2295184d-4f5e-4ae2-bef5-75bcf8c11cec]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd8b48-b14e-4014-9a85-9d3f6996cbb4]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] SCSI volumes sdi have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d5451f-746c-457e-9d4e-5e2f9d535384]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb9cd1-a413-4b67-a6ee-bfffdfe2a372]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260]
Jul 26 17:01:18 user nova-compute[70594]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:18 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64c062b-f1e7-46c6-9b02-0484f6b55baf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] <== disconnect_volume: return (340ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2c9162fc-40f6-462c-843a-fa279515db41', 'attached_at': '', 'detached_at': '', 'volume_id': '9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'serial'} {{(pid=70594) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] swap_volume: removing Cinder connection for volume 397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f {{(pid=70594) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-changed-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing instance network info cache due to event network-changed-553f56a5-67c1-4220-bc52-25aaa1cebcb8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] Acquiring lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] Acquired lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Refreshing network info cache for port 553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updated VIF entry in instance network info cache for port 553f56a5-67c1-4220-bc52-25aaa1cebcb8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:01:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7eb318c0-ae2b-42fc-a8e6-8cc9e9e4ffc9 req-e32e5899-a86a-4c39-8075-64d6b2721919 service nova] Releasing lock "refresh_cache-9b095024-0bcf-4aa9-818f-24b0efaba6c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:01:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] swap_volume: Updating volume 397f4ad7-074a-4ebb-ba1b-39b7eaf04f3f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "iHMDLQWR", "auth_password": "oBxNOqmDAji8C5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "9cde2fa9-c4c6-4a03-8977-cbde24dcaf19"}, "status": "reserved", "instance": "2c9162fc-40f6-462c-843a-fa279515db41", "attached_at": "", "detached_at": "", "volume_id": "9cde2fa9-c4c6-4a03-8977-cbde24dcaf19", "serial": "9cde2fa9-c4c6-4a03-8977-cbde24dcaf19"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'no_device': None, 'attachment_id': '915bc770-198d-451f-affb-27bf0e4ef6b2'} {{(pid=70594) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 26 17:01:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3b694004-648e-4c35-b777-5df31d059a74 tempest-TestVolumeSwap-677660110 tempest-TestVolumeSwap-677660110-project-admin] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.103s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:20 user nova-compute[70594]: INFO nova.compute.manager [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Detaching volume 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: INFO nova.virt.block_device [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Attempting to driver detach volume 9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 from mountpoint /dev/vdb
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Attempting to detach device vdb from instance 2c9162fc-40f6-462c-843a-fa279515db41 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:01:20 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:01:20 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:01:20 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:01:20 user nova-compute[70594]:   <serial>9cde2fa9-c4c6-4a03-8977-cbde24dcaf19</serial>
Jul 26 17:01:20 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:01:20 user nova-compute[70594]: </disk>
Jul 26 17:01:20 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:01:20 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Successfully detached device vdb from instance 2c9162fc-40f6-462c-843a-fa279515db41 from the persistent domain config.
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c9162fc-40f6-462c-843a-fa279515db41 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:01:20 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:01:20 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:01:20 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:01:20 user nova-compute[70594]:   <serial>9cde2fa9-c4c6-4a03-8977-cbde24dcaf19</serial>
Jul 26 17:01:20 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:01:20 user nova-compute[70594]: </disk>
Jul 26 17:01:20 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:20 user nova-compute[70594]: INFO nova.compute.manager [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Terminating instance
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690390880.9486806, 2c9162fc-40f6-462c-843a-fa279515db41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:01:20 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Successfully detached device vdb from instance 2c9162fc-40f6-462c-843a-fa279515db41 from the live domain config.
Jul 26 17:01:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHMDLQWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '9cde2fa9-c4c6-4a03-8977-cbde24dcaf19'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[db040b06-b19d-4192-b8de-0862615c6c2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:21 user nova-compute[70594]: No targets found.
Jul 26 17:01:21 user nova-compute[70594]: iSNS:
Jul 26 17:01:21 user nova-compute[70594]: No targets found.
Jul 26 17:01:21 user nova-compute[70594]: STATIC:
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:21 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:21 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:21 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:21 user nova-compute[70594]: No targets found.
Jul 26 17:01:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:21 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:21 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d424fdc-2699-4202-a8a8-b8f4565cea1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb862af-7aac-4f5c-865b-a14624c5dd0c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:21 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59102e97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19'): ({'sdh'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Removing single pathed devices sdh {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f211bc-46ef-48c0-b5bc-f19495a8b609]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec354a-83d7-4586-8beb-d378b1a8ba82]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Flushing IO for device /dev/sdh {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2170c4e-d997-432b-b0d4-b22a3f843be5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-5bf7e822-80ec-45af-b714-6b9edb50f792 req-c99d9c70-fb4e-43c7-93d0-af71f47b3e93 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5bf7e822-80ec-45af-b714-6b9edb50f792 req-c99d9c70-fb4e-43c7-93d0-af71f47b3e93 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5bf7e822-80ec-45af-b714-6b9edb50f792 req-c99d9c70-fb4e-43c7-93d0-af71f47b3e93 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5bf7e822-80ec-45af-b714-6b9edb50f792 req-c99d9c70-fb4e-43c7-93d0-af71f47b3e93 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-5bf7e822-80ec-45af-b714-6b9edb50f792 req-c99d9c70-fb4e-43c7-93d0-af71f47b3e93 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-5bf7e822-80ec-45af-b714-6b9edb50f792 req-c99d9c70-fb4e-43c7-93d0-af71f47b3e93 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb252f45-7599-4e99-821e-807c53590dbc]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f52856-410b-472c-94ac-0200ba6dcfdc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e990b157-ff7f-4d6b-b5c8-0f4e5c4627db]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260]
Jul 26 17:01:21 user nova-compute[70594]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cde2fa9-c4c6-4a03-8977-cbde24dcaf19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50a5009-d150-4fdc-8b47-9225f890768e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] <== disconnect_volume: return (413ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-8ba90c57-b5bc-48a4-9cfc-07b3e6725603 req-548c0fc6-113c-4199-a406-64ece2993cf6 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8ba90c57-b5bc-48a4-9cfc-07b3e6725603 req-548c0fc6-113c-4199-a406-64ece2993cf6 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8ba90c57-b5bc-48a4-9cfc-07b3e6725603 req-548c0fc6-113c-4199-a406-64ece2993cf6 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8ba90c57-b5bc-48a4-9cfc-07b3e6725603 req-548c0fc6-113c-4199-a406-64ece2993cf6 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-8ba90c57-b5bc-48a4-9cfc-07b3e6725603 req-548c0fc6-113c-4199-a406-64ece2993cf6 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-8ba90c57-b5bc-48a4-9cfc-07b3e6725603 req-548c0fc6-113c-4199-a406-64ece2993cf6 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-ea9b3fcd-91c0-408c-b803-a8123845e257 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-d1c9528c-5ff4-457f-a70d-459d4587ba87 req-2642debe-b4ed-402f-b519-c2168d75ef57 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d1c9528c-5ff4-457f-a70d-459d4587ba87 req-2642debe-b4ed-402f-b519-c2168d75ef57 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d1c9528c-5ff4-457f-a70d-459d4587ba87 req-2642debe-b4ed-402f-b519-c2168d75ef57 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d1c9528c-5ff4-457f-a70d-459d4587ba87 req-2642debe-b4ed-402f-b519-c2168d75ef57 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-d1c9528c-5ff4-457f-a70d-459d4587ba87 req-2642debe-b4ed-402f-b519-c2168d75ef57 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-d1c9528c-5ff4-457f-a70d-459d4587ba87 req-2642debe-b4ed-402f-b519-c2168d75ef57 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-74223b9a-fdb0-40e2-a89f-9f51e613240c for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lazy-loading 'flavor' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a074fafd-489e-4eb6-9f0e-3521d0b1f8bf tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.063s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Instance destroyed successfully.
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lazy-loading 'resources' on Instance uuid 9b095024-0bcf-4aa9-818f-24b0efaba6c7 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "address": "fa:16:3e:6c:31:60", "network": {"id": "30db5562-17c3-4046-970e-b75114729ba8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-691804409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553f56a5-67", "ovs_interfaceid": "553f56a5-67c1-4220-bc52-25aaa1cebcb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap553f56a5-67, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:31:60,bridge_name='br-int',has_traffic_filtering=True,id=553f56a5-67c1-4220-bc52-25aaa1cebcb8,network=Network(30db5562-17c3-4046-970e-b75114729ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553f56a5-67')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef89f7d7-93, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=ef89f7d7-9327-4e87-9844-94ff7efd540b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef89f7d7-93')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea9b3fcd-91, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:72:37,bridge_name='br-int',has_traffic_filtering=True,id=ea9b3fcd-91c0-408c-b803-a8123845e257,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapea9b3fcd-91')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc6ab61-a7, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:e2:3a,bridge_name='br-int',has_traffic_filtering=True,id=ddc6ab61-a7cd-450e-a871-219b444cfa7b,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc6ab61-a7')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00f67f88-91, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=00f67f88-91ff-4694-98d4-68cfc34f7093,network=Network(1b0dafbd-d67b-4891-9b59-bf58e2477842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f67f88-91')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc871be06-cc, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:97:b8,bridge_name='br-int',has_traffic_filtering=True,id=c871be06-cc02-42a2-b0a3-6ac143a3c34f,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc871be06-cc')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1256874851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1256874851',id=12,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYVOhTtqg+KspwGLtuytHRzhQFzIDaxAUw6U9Ya+ENyfBJGCpU2CAhA8cQRIhNH8piG8UZn8oSkrvMSveMssL0xzPtGE23qcEHbhO6sG4tqu6BAm9Hcp0yb1nvm+KTnpA==',key_name='tempest-keypair-1192223683',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e13545da03d4e1fa8c8d5aec922d68a',ramdisk_id='',reservation_id='r-i82s7e16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-949285266',owner_user_name='tempest-TaggedBootDevicesTest-949285266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccef7da90a6465489af0908b2627a96',uuid=9b095024-0bcf-4aa9-818f-24b0efaba6c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converting VIF {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74223b9a-fd, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:22 user nova-compute[70594]: INFO os_vif [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=74223b9a-fdb0-40e2-a89f-9f51e613240c,network=Network(4b41489d-3d68-4509-b5b5-e766b6fd126e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74223b9a-fd')
Jul 26 17:01:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbCHaPgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:22 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8150bbc-d998-482b-bcfe-415d36ff3094]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:22 user nova-compute[70594]: No targets found.
Jul 26 17:01:22 user nova-compute[70594]: iSNS:
Jul 26 17:01:22 user nova-compute[70594]: No targets found.
Jul 26 17:01:22 user nova-compute[70594]: STATIC:
Jul 26 17:01:22 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:22 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:22 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:22 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:01:22 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:22 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:22 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88
Jul 26 17:01:22 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:22 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:22 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:22 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:22 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:22 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:01:22 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:22 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:22 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:22 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:22 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:22 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:22 user nova-compute[70594]: No targets found.
Jul 26 17:01:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:22 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:22 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2a3592-8e76-400f-bc66-4a9ddf1f3fa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[991a49be-70a9-4ca0-9ac8-7276cc1898aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:22 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5918167e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7651de04-cd9a-4a0e-a5bd-1c6de66fac7a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857b712-4588-4403-b5c2-39b672dcaa7b]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a1ffb-73e4-43ac-b4be-0352e623457e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de448d9-2872-4234-bad1-53064a5346cb]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2bed5-d6a2-413f-8775-d0ab9a830fe7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4adba89-dca7-4e68-a3a4-74a503c90423]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260]
Jul 26 17:01:23 user nova-compute[70594]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01a43c9e-cdc7-4fda-af62-749728fd4e88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c5602-22c0-4377-aa7d-68d3e8f980e4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== disconnect_volume: return (339ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYqHIosw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d1d630-c58e-4077-83a0-a6ccdad13dbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:23 user nova-compute[70594]: No targets found.
Jul 26 17:01:23 user nova-compute[70594]: iSNS:
Jul 26 17:01:23 user nova-compute[70594]: No targets found.
Jul 26 17:01:23 user nova-compute[70594]: STATIC:
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:23 user nova-compute[70594]: No targets found.
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:23 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:23 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff0c68c-e649-4dde-9ecf-8165bfe0cd03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8165df-bf2f-465a-8db8-a7dab4659d3d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910490820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[081fd45f-081b-4409-b98e-389822f36f09]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-553f56a5-67c1-4220-bc52-25aaa1cebcb8 for instance with vm_state active and task_state deleting.
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-ef89f7d7-9327-4e87-9844-94ff7efd540b for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ef89f7d7-9327-4e87-9844-94ff7efd540b for instance with vm_state active and task_state deleting.
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ddc6ab61-a7cd-450e-a871-219b444cfa7b for instance with vm_state active and task_state deleting.
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-3f4e49a9-5c63-4061-91e6-60fd2311e485 req-936e24f1-c86c-4a59-82d4-a2bf4e7510d3 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d955f-73d0-45f6-81fe-9d41ac90a0c3]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea86c057-d5d9-456c-88ba-291887c19fe4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[efac3adb-655a-4855-aca5-19a96dc2b6c4]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f116d0-5d5a-418b-b9d5-197f34c300b9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07e9705-7136-4a65-a6b4-383fc198a94f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260]
Jul 26 17:01:23 user nova-compute[70594]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c425d92-1440-4a2e-811d-43dd065fc5fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53ea28-df92-4898-9928-dbc3837c1aed]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== disconnect_volume: return (359ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhVfYKuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[462a78d0-3bda-41be-bcce-95d0d34b16da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:23 user nova-compute[70594]: No targets found.
Jul 26 17:01:23 user nova-compute[70594]: iSNS:
Jul 26 17:01:23 user nova-compute[70594]: No targets found.
Jul 26 17:01:23 user nova-compute[70594]: STATIC:
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:23 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:23 user nova-compute[70594]: No targets found.
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:23 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:23 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-ea9b3fcd-91c0-408c-b803-a8123845e257 for instance with vm_state active and task_state deleting.
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-unplugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-unplugged-00f67f88-91ff-4694-98d4-68cfc34f7093 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING nova.compute.manager [req-034236a0-8041-4237-85bc-dfb55b9ce809 req-48502cd2-4c28-4127-b622-2a8bc1da6f9f service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-00f67f88-91ff-4694-98d4-68cfc34f7093 for instance with vm_state active and task_state deleting.
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3452c-a783-43c1-a0ec-6f35c88b7c0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d2e3a-52ed-4f08-8b77-8fed441723bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:23 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59102ebac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320'): ({'sdb'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Removing single pathed devices sdb {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02155b94-d88c-46b8-9aa2-4f4103a2a43a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf226a2-1b52-4794-8046-bfc6f32cfc1f]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Flushing IO for device /dev/sdb {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e9ad5-9496-4b4d-80f6-92a810009c7f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-b2f392d0-2a7c-4be5-ab19-b38da1c73c87 req-7b39ccb6-b17f-4d8d-8c57-1fc94ef82253 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b2f392d0-2a7c-4be5-ab19-b38da1c73c87 req-7b39ccb6-b17f-4d8d-8c57-1fc94ef82253 service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b2f392d0-2a7c-4be5-ab19-b38da1c73c87 req-7b39ccb6-b17f-4d8d-8c57-1fc94ef82253 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b2f392d0-2a7c-4be5-ab19-b38da1c73c87 req-7b39ccb6-b17f-4d8d-8c57-1fc94ef82253 service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-b2f392d0-2a7c-4be5-ab19-b38da1c73c87 req-7b39ccb6-b17f-4d8d-8c57-1fc94ef82253 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:23 user nova-compute[70594]: WARNING nova.compute.manager [req-b2f392d0-2a7c-4be5-ab19-b38da1c73c87 req-7b39ccb6-b17f-4d8d-8c57-1fc94ef82253 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-74223b9a-fdb0-40e2-a89f-9f51e613240c for instance with vm_state active and task_state deleting.
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.126s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58588c77-c0af-43b3-883a-86677d20bf7c]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[637da46c-1f2d-4960-a786-d91ad744218e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613106e-4dee-4d7f-8d53-5ebf70d48ec0]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260]
Jul 26 17:01:23 user nova-compute[70594]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d579203-5a1f-402b-8e15-8674312f3320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c391f8-7f1a-4775-a42e-0b25b1f702eb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] <== disconnect_volume: return (405ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:23 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Deleting instance files /opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7_del
Jul 26 17:01:23 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Deletion of /opt/stack/data/nova/instances/9b095024-0bcf-4aa9-818f-24b0efaba6c7_del complete
Jul 26 17:01:24 user nova-compute[70594]: INFO nova.compute.manager [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Took 3.33 seconds to destroy the instance on the hypervisor.
Jul 26 17:01:24 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:01:24 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:01:24 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:01:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb1f6828-9187-452f-9925-55569bd0eaf2 req-2f973fd9-c096-4743-92b9-8a9ca67fd6fe service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb1f6828-9187-452f-9925-55569bd0eaf2 req-2f973fd9-c096-4743-92b9-8a9ca67fd6fe service nova] Acquiring lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb1f6828-9187-452f-9925-55569bd0eaf2 req-2f973fd9-c096-4743-92b9-8a9ca67fd6fe service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cb1f6828-9187-452f-9925-55569bd0eaf2 req-2f973fd9-c096-4743-92b9-8a9ca67fd6fe service nova] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-cb1f6828-9187-452f-9925-55569bd0eaf2 req-2f973fd9-c096-4743-92b9-8a9ca67fd6fe service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] No waiting events found dispatching network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:25 user nova-compute[70594]: WARNING nova.compute.manager [req-cb1f6828-9187-452f-9925-55569bd0eaf2 req-2f973fd9-c096-4743-92b9-8a9ca67fd6fe service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received unexpected event network-vif-plugged-c871be06-cc02-42a2-b0a3-6ac143a3c34f for instance with vm_state active and task_state deleting.
Jul 26 17:01:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-changed-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing instance network info cache due to event network-changed-9d59da8a-c099-4245-b965-3f07c15d0088. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] Acquiring lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] Acquired lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Refreshing network info cache for port 9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:01:26 user nova-compute[70594]: INFO nova.compute.claims [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Claim successful on node user
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:01:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:01:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Creating image(s)
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "/opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.policy [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6af9ec8d9d644c89ba32c10861afba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd253357a8f7b42119a7b91385afa0e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updated VIF entry in instance network info cache for port 9d59da8a-c099-4245-b965-3f07c15d0088. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4cdce3e1-8baa-4c44-923c-c0f03be3e3d1 req-d1ceecde-ea43-4a92-a8ec-f26de5aa7581 service nova] Releasing lock "refresh_cache-58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk 1073741824" returned: 0 in 0.051s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.129s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Cannot resize image /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'migration_context' on Instance uuid 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Ensure instance console log exists: /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG nova.compute.manager [req-418ee00b-e4fa-4e02-b60f-1e5e1a51d0fc req-591f902c-3174-458b-8069-b8930241c9b4 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-deleted-553f56a5-67c1-4220-bc52-25aaa1cebcb8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:28 user nova-compute[70594]: INFO nova.compute.manager [req-418ee00b-e4fa-4e02-b60f-1e5e1a51d0fc req-591f902c-3174-458b-8069-b8930241c9b4 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Neutron deleted interface 553f56a5-67c1-4220-bc52-25aaa1cebcb8; detaching it from the instance and deleting it from the info cache
Jul 26 17:01:28 user nova-compute[70594]: DEBUG nova.network.neutron [req-418ee00b-e4fa-4e02-b60f-1e5e1a51d0fc req-591f902c-3174-458b-8069-b8930241c9b4 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "address": "fa:16:3e:15:ee:e3", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74223b9a-fd", "ovs_interfaceid": "74223b9a-fdb0-40e2-a89f-9f51e613240c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG nova.compute.manager [req-418ee00b-e4fa-4e02-b60f-1e5e1a51d0fc req-591f902c-3174-458b-8069-b8930241c9b4 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Detach interface failed, port_id=553f56a5-67c1-4220-bc52-25aaa1cebcb8, reason: Instance 9b095024-0bcf-4aa9-818f-24b0efaba6c7 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Successfully created port: 12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:28 user nova-compute[70594]: INFO nova.compute.manager [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Terminating instance
Jul 26 17:01:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-359b6e47-c0cf-42b9-b1df-a12d08811c3e req-15690b14-ab1f-4979-a522-f6f817da42e5 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-359b6e47-c0cf-42b9-b1df-a12d08811c3e req-15690b14-ab1f-4979-a522-f6f817da42e5 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-359b6e47-c0cf-42b9-b1df-a12d08811c3e req-15690b14-ab1f-4979-a522-f6f817da42e5 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-359b6e47-c0cf-42b9-b1df-a12d08811c3e req-15690b14-ab1f-4979-a522-f6f817da42e5 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-359b6e47-c0cf-42b9-b1df-a12d08811c3e req-15690b14-ab1f-4979-a522-f6f817da42e5 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-359b6e47-c0cf-42b9-b1df-a12d08811c3e req-15690b14-ab1f-4979-a522-f6f817da42e5 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-9d59da8a-c099-4245-b965-3f07c15d0088 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-deleted-74223b9a-fdb0-40e2-a89f-9f51e613240c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:30 user nova-compute[70594]: INFO nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Neutron deleted interface 74223b9a-fdb0-40e2-a89f-9f51e613240c; detaching it from the instance and deleting it from the info cache
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "address": "fa:16:3e:c6:e2:3a", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc6ab61-a7", "ovs_interfaceid": "ddc6ab61-a7cd-450e-a871-219b444cfa7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Detach interface failed, port_id=74223b9a-fdb0-40e2-a89f-9f51e613240c, reason: Instance 9b095024-0bcf-4aa9-818f-24b0efaba6c7 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-deleted-ddc6ab61-a7cd-450e-a871-219b444cfa7b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:30 user nova-compute[70594]: INFO nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Neutron deleted interface ddc6ab61-a7cd-450e-a871-219b444cfa7b; detaching it from the instance and deleting it from the info cache
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [{"id": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "address": "fa:16:3e:41:cd:85", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef89f7d7-93", "ovs_interfaceid": "ef89f7d7-9327-4e87-9844-94ff7efd540b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9b3fcd-91c0-408c-b803-a8123845e257", "address": "fa:16:3e:67:72:37", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9b3fcd-91", "ovs_interfaceid": "ea9b3fcd-91c0-408c-b803-a8123845e257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00f67f88-91ff-4694-98d4-68cfc34f7093", "address": "fa:16:3e:a8:bd:93", "network": {"id": "1b0dafbd-d67b-4891-9b59-bf58e2477842", "bridge": "br-int", "label": "tempest-device-tagging-net1-1809260270", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f67f88-91", "ovs_interfaceid": "00f67f88-91ff-4694-98d4-68cfc34f7093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "address": "fa:16:3e:a5:97:b8", "network": {"id": "4b41489d-3d68-4509-b5b5-e766b6fd126e", "bridge": "br-int", "label": "tempest-device-tagging-net2-108536445", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3e13545da03d4e1fa8c8d5aec922d68a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc871be06-cc", "ovs_interfaceid": "c871be06-cc02-42a2-b0a3-6ac143a3c34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Detach interface failed, port_id=ddc6ab61-a7cd-450e-a871-219b444cfa7b, reason: Instance 9b095024-0bcf-4aa9-818f-24b0efaba6c7 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d52a22-b4ea-4e39-9961-d76eb1cbffad req-f30b0b2f-3d74-4c55-924d-b255146675ff service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Successfully updated port: 12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:01:30 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Instance destroyed successfully.
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lazy-loading 'resources' on Instance uuid 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d59da8a-c0, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=9d59da8a-c099-4245-b965-3f07c15d0088,network=Network(a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d59da8a-c0')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.neutron [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60871186-c9, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fb:5e,bridge_name='br-int',has_traffic_filtering=True,id=60871186-c933-413b-be74-a261061e4437,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60871186-c9')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3d7ba1-81, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:8d,bridge_name='br-int',has_traffic_filtering=True,id=1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3d7ba1-81')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b00967a-2f, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:20,bridge_name='br-int',has_traffic_filtering=True,id=8b00967a-2f00-4507-9a9a-e40bb2a0cdeb,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b00967a-2f')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap785fc53b-ec, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:00:6d,bridge_name='br-int',has_traffic_filtering=True,id=785fc53b-ec01-487e-a17f-c30e6af84840,network=Network(b771b3a9-3854-4492-9d3f-c0284a12aabc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap785fc53b-ec')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "f4a80119-224e-427e-93e8-afbb621d7b07", "address": "fa:16:3e:b7:ea:51", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a80119-22", "ovs_interfaceid": "f4a80119-224e-427e-93e8-afbb621d7b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a80119-22, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ea:51,bridge_name='br-int',has_traffic_filtering=True,id=f4a80119-224e-427e-93e8-afbb621d7b07,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a80119-22')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T16:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1255705891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1255705891',id=13,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyLi2ZxE29+x+EkXRaJpy1WkpV9+J4hqqxZUlp3kNt96YJX6KH5nE+IJnLHum8eE3/fD4LSCMroJkqubmgTfvj8GsRgvDidGlzoGI3NoheJI3bPclT7P03A9apGlhB8JA==',key_name='tempest-keypair-1549707380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff34d709dbe4028b779b7bc2ddf671a',ramdisk_id='',reservation_id='r-f11ud86r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-826283036',owner_user_name='tempest-TaggedBootDevicesTest_v242-826283036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2666eb218f1342cf8e35a6630ec7cbe4',uuid=58bf4d75-dfda-4ba8-91bd-5afb2a20ef35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converting VIF {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8babdc9b-f9, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:21:10,bridge_name='br-int',has_traffic_filtering=True,id=8babdc9b-f953-4d18-b754-8355b0dd3109,network=Network(817b75ca-0b90-4e5b-867d-2f1138803aa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8babdc9b-f9')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbCFKLSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca30ed-ad65-41c3-b0b2-86f0212fea84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:31 user nova-compute[70594]: No targets found.
Jul 26 17:01:31 user nova-compute[70594]: iSNS:
Jul 26 17:01:31 user nova-compute[70594]: No targets found.
Jul 26 17:01:31 user nova-compute[70594]: STATIC:
Jul 26 17:01:31 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:31 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:31 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:31 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:31 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:31 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:31 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae
Jul 26 17:01:31 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:31 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:31 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:31 user nova-compute[70594]: No targets found.
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:31 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:31 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b35a5a-0c21-4da3-9fcd-85a41173b97d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a272c7f0-555b-4755-9ce2-f7cd7578e4d9]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:31 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae (non-flash)
Jul 26 17:01:31 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591db376d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae'): ({'sdf'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Removing single pathed devices sdf {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37075fce-864e-4319-a766-29860cd161e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83dc091-ae9f-4d48-ac8a-9f663cf2bef5]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Flushing IO for device /dev/sdf {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b0d1e-f1ed-41f2-a929-6fdf7a64c7a6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b9a47-3c08-48d4-9e6a-f8ee3422b70d]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b31cd1c-65a7-4286-9120-7cefda7f3ef7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-9d59da8a-c099-4245-b965-3f07c15d0088 for instance with vm_state active and task_state deleting.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-60871186-c933-413b-be74-a261061e4437 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-60871186-c933-413b-be74-a261061e4437 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-60871186-c933-413b-be74-a261061e4437 for instance with vm_state active and task_state deleting.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb for instance with vm_state active and task_state deleting.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-785fc53b-ec01-487e-a17f-c30e6af84840 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-785fc53b-ec01-487e-a17f-c30e6af84840 for instance with vm_state active and task_state deleting.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-8babdc9b-f953-4d18-b754-8355b0dd3109 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.compute.manager [req-84485333-6623-4075-8f5f-3dd3da773685 req-d9bd21ae-12c2-4feb-b66d-83fb1375540f service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-8babdc9b-f953-4d18-b754-8355b0dd3109 for instance with vm_state active and task_state deleting.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a4ea6-c25f-430e-9054-5e1e854e516e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260]
Jul 26 17:01:31 user nova-compute[70594]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198a2ca2-6a4a-4715-af3e-9fb19ff577ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f470b727-8468-481c-8f89-9be8bd34baa0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== disconnect_volume: return (321ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfiFNtcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.neutron [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updating instance_info_cache with network_info: [{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37e92c-89bc-4260-a38d-a7aa126aa36c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:31 user nova-compute[70594]: No targets found.
Jul 26 17:01:31 user nova-compute[70594]: iSNS:
Jul 26 17:01:31 user nova-compute[70594]: No targets found.
Jul 26 17:01:31 user nova-compute[70594]: STATIC:
Jul 26 17:01:31 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:31 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:31 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:31 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5
Jul 26 17:01:31 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:31 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:31 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:31 user nova-compute[70594]: No targets found.
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:31 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:31 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Instance network_info: |[{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Start _get_guest_xml network_info=[{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:01:31 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[506936f3-bfa2-4f60-a47c-c7bcc62a86a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:01:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-101036294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-101036294',id=15,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-k0nluta0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:01:27Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=00db1375-a1ef-4f03-a7ed-00f75f3e12c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'pci_devices' on Instance uuid 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e072a97-c816-44c2-aeef-1e4c1d998213]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 (non-flash)
Jul 26 17:01:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910657c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5'): ({'sdg'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Removing single pathed devices sdg {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:01:31 user nova-compute[70594]:   <uuid>00db1375-a1ef-4f03-a7ed-00f75f3e12c6</uuid>
Jul 26 17:01:31 user nova-compute[70594]:   <name>instance-0000000f</name>
Jul 26 17:01:31 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:01:31 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:01:31 user nova-compute[70594]:   <metadata>
Jul 26 17:01:31 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:01:31 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:01:31 user nova-compute[70594]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-101036294</nova:name>
Jul 26 17:01:31 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:01:31</nova:creationTime>
Jul 26 17:01:31 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:01:31 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:01:31 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:01:31 user nova-compute[70594]:       <nova:owner>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:user uuid="f6af9ec8d9d644c89ba32c10861afba2">tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member</nova:user>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:project uuid="d253357a8f7b42119a7b91385afa0e8b">tempest-ServerBootFromVolumeStableRescueTest-43751456</nova:project>
Jul 26 17:01:31 user nova-compute[70594]:       </nova:owner>
Jul 26 17:01:31 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:01:31 user nova-compute[70594]:       <nova:ports>
Jul 26 17:01:31 user nova-compute[70594]:         <nova:port uuid="12819d23-fd02-422e-a30b-7bc1ec5374b2">
Jul 26 17:01:31 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 26 17:01:31 user nova-compute[70594]:         </nova:port>
Jul 26 17:01:31 user nova-compute[70594]:       </nova:ports>
Jul 26 17:01:31 user nova-compute[70594]:     </nova:instance>
Jul 26 17:01:31 user nova-compute[70594]:   </metadata>
Jul 26 17:01:31 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:01:31 user nova-compute[70594]:     <system>
Jul 26 17:01:31 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:01:31 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:01:31 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:01:31 user nova-compute[70594]:       <entry name="serial">00db1375-a1ef-4f03-a7ed-00f75f3e12c6</entry>
Jul 26 17:01:31 user nova-compute[70594]:       <entry name="uuid">00db1375-a1ef-4f03-a7ed-00f75f3e12c6</entry>
Jul 26 17:01:31 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:01:31 user nova-compute[70594]:     </system>
Jul 26 17:01:31 user nova-compute[70594]:   </sysinfo>
Jul 26 17:01:31 user nova-compute[70594]:   <os>
Jul 26 17:01:31 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:01:31 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:01:31 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:01:31 user nova-compute[70594]:   </os>
Jul 26 17:01:31 user nova-compute[70594]:   <features>
Jul 26 17:01:31 user nova-compute[70594]:     <acpi/>
Jul 26 17:01:31 user nova-compute[70594]:     <apic/>
Jul 26 17:01:31 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:01:31 user nova-compute[70594]:   </features>
Jul 26 17:01:31 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:01:31 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:01:31 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:01:31 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:01:31 user nova-compute[70594]:   </clock>
Jul 26 17:01:31 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:01:31 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:01:31 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:01:31 user nova-compute[70594]:   </cpu>
Jul 26 17:01:31 user nova-compute[70594]:   <devices>
Jul 26 17:01:31 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:01:31 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:01:31 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk"/>
Jul 26 17:01:31 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:01:31 user nova-compute[70594]:     </disk>
Jul 26 17:01:31 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:01:31 user nova-compute[70594]:       <mac address="fa:16:3e:e2:e2:55"/>
Jul 26 17:01:31 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:01:31 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:01:31 user nova-compute[70594]:       <target dev="tap12819d23-fd"/>
Jul 26 17:01:31 user nova-compute[70594]:     </interface>
Jul 26 17:01:31 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:01:31 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/console.log" append="off"/>
Jul 26 17:01:31 user nova-compute[70594]:     </serial>
Jul 26 17:01:31 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:01:31 user nova-compute[70594]:     <video>
Jul 26 17:01:31 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:01:31 user nova-compute[70594]:     </video>
Jul 26 17:01:31 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:01:31 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:01:31 user nova-compute[70594]:     </rng>
Jul 26 17:01:31 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:01:31 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:01:31 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:01:31 user nova-compute[70594]:     </memballoon>
Jul 26 17:01:31 user nova-compute[70594]:   </devices>
Jul 26 17:01:31 user nova-compute[70594]: </domain>
Jul 26 17:01:31 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:01:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-101036294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-101036294',id=15,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-k0nluta0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:01:27Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=00db1375-a1ef-4f03-a7ed-00f75f3e12c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_vif [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12819d23-fd, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12819d23-fd, col_values=(('external_ids', {'iface-id': '12819d23-fd02-422e-a30b-7bc1ec5374b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e2:55', 'vm-uuid': '00db1375-a1ef-4f03-a7ed-00f75f3e12c6'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2290a707-07b4-41e1-a339-4f840fb0af0e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:31 user nova-compute[70594]: INFO os_vif [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd')
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd4cfc1-2133-4f76-bc1b-53fc4e1a736a]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Flushing IO for device /dev/sdg {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dced74-e6ec-420d-b763-8826ba18b9da]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453b0e2-88a8-4134-b2c1-fc1245d5d4f3]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] SCSI volumes sdg have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No VIF found with MAC fa:16:3e:e2:e2:55, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:01:31 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Took 7.85 seconds to deallocate network for instance.
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b268e73a-797f-44f6-85f3-ab0592735a60]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.142s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad13d0e1-02d4-4c35-b097-885cdf9832b1]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260]
Jul 26 17:01:32 user nova-compute[70594]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b25bf1e-eee4-4e43-93af-077bd614b1c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8636ad-c8ab-4754-a8fd-7c1b9850b0a5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== disconnect_volume: return (442ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XFDZQYkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aecf6d3-54dc-467c-9dab-f4c899eb5eba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:01:32 user nova-compute[70594]: No targets found.
Jul 26 17:01:32 user nova-compute[70594]: iSNS:
Jul 26 17:01:32 user nova-compute[70594]: No targets found.
Jul 26 17:01:32 user nova-compute[70594]: STATIC:
Jul 26 17:01:32 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877
Jul 26 17:01:32 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:01:32 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:01:32 user nova-compute[70594]: FIRMWARE:
Jul 26 17:01:32 user nova-compute[70594]: No targets found.
Jul 26 17:01:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:01:32 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:01:32 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b350a86-0a19-441a-be2a-81fd3aadb2dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a7c457-29b9-44e1-8e38-ff7b05dc86f7]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 (non-flash)
Jul 26 17:01:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591db37ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de5225-acc0-4293-8e48-49cd83005f67]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d6df9-fb72-4342-8f5f-dc78e570e389]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ae45c-88bb-46d0-9b99-a8a9edac416f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef7248f-98ea-4b32-8a90-7c114b54b59f]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2767d70a-f5b4-423b-a67e-685b2dab905c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-changed-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Refreshing instance network info cache due to event network-changed-12819d23-fd02-422e-a30b-7bc1ec5374b2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Acquiring lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Acquired lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.network.neutron [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Refreshing network info cache for port 12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[851c1463-a1bc-472d-a16a-4e3e18d8db2d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260]
Jul 26 17:01:32 user nova-compute[70594]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877, portal: 172.16.0.220,3260] successful.
Jul 26 17:01:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5e19756-6c79-46c9-a09f-8ed4fa7b5877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d91d5-f927-4c12-b81a-5b86e3e4c720]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] <== disconnect_volume: return (352ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:01:32 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Deleting instance files /opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35_del
Jul 26 17:01:32 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Deletion of /opt/stack/data/nova/instances/58bf4d75-dfda-4ba8-91bd-5afb2a20ef35_del complete
Jul 26 17:01:32 user nova-compute[70594]: INFO nova.compute.manager [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Took 3.57 seconds to destroy the instance on the hypervisor.
Jul 26 17:01:32 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:01:32 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updated VIF entry in instance network info cache for port 12819d23-fd02-422e-a30b-7bc1ec5374b2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updating instance_info_cache with network_info: [{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Releasing lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:33 user nova-compute[70594]: WARNING nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27 for instance with vm_state active and task_state deleting.
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-deleted-00f67f88-91ff-4694-98d4-68cfc34f7093 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-unplugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-unplugged-f4a80119-224e-427e-93e8-afbb621d7b07 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Received event network-vif-deleted-c871be06-cc02-42a2-b0a3-6ac143a3c34f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Acquiring lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] No waiting events found dispatching network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:33 user nova-compute[70594]: WARNING nova.compute.manager [req-9bdf0283-53ce-4da8-981a-0b89a5f629ec req-980027b0-6cb6-47bb-9b7f-7211b4707797 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received unexpected event network-vif-plugged-f4a80119-224e-427e-93e8-afbb621d7b07 for instance with vm_state active and task_state deleting.
Jul 26 17:01:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c1afb3a-93eb-4801-ac0a-7bc813378b2e req-cb75075e-b8fd-4c68-9dc7-1cb28c183a88 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c1afb3a-93eb-4801-ac0a-7bc813378b2e req-cb75075e-b8fd-4c68-9dc7-1cb28c183a88 service nova] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c1afb3a-93eb-4801-ac0a-7bc813378b2e req-cb75075e-b8fd-4c68-9dc7-1cb28c183a88 service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c1afb3a-93eb-4801-ac0a-7bc813378b2e req-cb75075e-b8fd-4c68-9dc7-1cb28c183a88 service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c1afb3a-93eb-4801-ac0a-7bc813378b2e req-cb75075e-b8fd-4c68-9dc7-1cb28c183a88 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] No waiting events found dispatching network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:34 user nova-compute[70594]: WARNING nova.compute.manager [req-3c1afb3a-93eb-4801-ac0a-7bc813378b2e req-cb75075e-b8fd-4c68-9dc7-1cb28c183a88 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received unexpected event network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 for instance with vm_state building and task_state spawning.
Jul 26 17:01:34 user nova-compute[70594]: INFO nova.compute.manager [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Took 2.69 seconds to detach 3 volumes for instance.
Jul 26 17:01:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:01:34 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:35 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Deleted allocations for instance 9b095024-0bcf-4aa9-818f-24b0efaba6c7
Jul 26 17:01:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e95419-de39-40f5-b18a-f517a46babb6 tempest-TaggedBootDevicesTest-949285266 tempest-TaggedBootDevicesTest-949285266-project-member] Lock "9b095024-0bcf-4aa9-818f-24b0efaba6c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.468s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390895.899348, 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] VM Resumed (Lifecycle Event)
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:01:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Instance spawned successfully.
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:01:35 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390895.9034824, 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] VM Started (Lifecycle Event)
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:01:36 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:01:36 user nova-compute[70594]: INFO nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Took 8.95 seconds to spawn the instance on the hypervisor.
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:36 user nova-compute[70594]: INFO nova.compute.manager [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Took 9.70 seconds to build instance.
Jul 26 17:01:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-12cec511-3b61-4058-85e6-b6cbd1a84445 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.807s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] No waiting events found dispatching network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:36 user nova-compute[70594]: WARNING nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received unexpected event network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 for instance with vm_state active and task_state None.
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-deleted-f4a80119-224e-427e-93e8-afbb621d7b07 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:36 user nova-compute[70594]: INFO nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Neutron deleted interface f4a80119-224e-427e-93e8-afbb621d7b07; detaching it from the instance and deleting it from the info cache
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "785fc53b-ec01-487e-a17f-c30e6af84840", "address": "fa:16:3e:79:00:6d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap785fc53b-ec", "ovs_interfaceid": "785fc53b-ec01-487e-a17f-c30e6af84840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Detach interface failed, port_id=f4a80119-224e-427e-93e8-afbb621d7b07, reason: Instance 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-deleted-785fc53b-ec01-487e-a17f-c30e6af84840 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:36 user nova-compute[70594]: INFO nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Neutron deleted interface 785fc53b-ec01-487e-a17f-c30e6af84840; detaching it from the instance and deleting it from the info cache
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [{"id": "9d59da8a-c099-4245-b965-3f07c15d0088", "address": "fa:16:3e:4f:90:ce", "network": {"id": "a5cc8e62-b5af-4d90-9e30-8b2bea4c57c4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-710665753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d59da8a-c0", "ovs_interfaceid": "9d59da8a-c099-4245-b965-3f07c15d0088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60871186-c933-413b-be74-a261061e4437", "address": "fa:16:3e:df:fb:5e", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60871186-c9", "ovs_interfaceid": "60871186-c933-413b-be74-a261061e4437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "address": "fa:16:3e:46:5a:8d", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3d7ba1-81", "ovs_interfaceid": "1b3d7ba1-8176-45eb-b58e-4cc29f5d0b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "address": "fa:16:3e:4b:38:20", "network": {"id": "b771b3a9-3854-4492-9d3f-c0284a12aabc", "bridge": "br-int", "label": "tempest-device-tagging-net1-536351780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b00967a-2f", "ovs_interfaceid": "8b00967a-2f00-4507-9a9a-e40bb2a0cdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8babdc9b-f953-4d18-b754-8355b0dd3109", "address": "fa:16:3e:f9:21:10", "network": {"id": "817b75ca-0b90-4e5b-867d-2f1138803aa8", "bridge": "br-int", "label": "tempest-device-tagging-net2-743855136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2ff34d709dbe4028b779b7bc2ddf671a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8babdc9b-f9", "ovs_interfaceid": "8babdc9b-f953-4d18-b754-8355b0dd3109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-46e097f7-e61e-4506-bc1f-4c8199fc2bee req-9b21cfad-eca7-45a0-8836-110ffe9a88e9 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Detach interface failed, port_id=785fc53b-ec01-487e-a17f-c30e6af84840, reason: Instance 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:01:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:37 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:37 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Took 4.71 seconds to deallocate network for instance.
Jul 26 17:01:37 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390882.4515636, 9b095024-0bcf-4aa9-818f-24b0efaba6c7 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:37 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] VM Stopped (Lifecycle Event)
Jul 26 17:01:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ecaf9f21-1f43-41c5-b99f-10afb4c8604f None None] [instance: 9b095024-0bcf-4aa9-818f-24b0efaba6c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-f3e83ca3-9ddc-44f4-9dfb-447d39191e82 req-410faf35-a9ed-4db1-a657-45ce1fb7b347 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-deleted-9d59da8a-c099-4245-b965-3f07c15d0088 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-f3e83ca3-9ddc-44f4-9dfb-447d39191e82 req-410faf35-a9ed-4db1-a657-45ce1fb7b347 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-deleted-8b00967a-2f00-4507-9a9a-e40bb2a0cdeb {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-f3e83ca3-9ddc-44f4-9dfb-447d39191e82 req-410faf35-a9ed-4db1-a657-45ce1fb7b347 service nova] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Received event network-vif-deleted-8babdc9b-f953-4d18-b754-8355b0dd3109 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:38 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:01:38 user nova-compute[70594]: INFO nova.compute.claims [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Claim successful on node user
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.network.neutron [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:01:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.policy [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4ffde3f244e4ac1923e33f7a9f048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74144c8b9bb4410983f5b3b496a1aa87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:01:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Creating image(s)
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "/opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "/opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:39 user nova-compute[70594]: INFO nova.compute.manager [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Took 2.58 seconds to detach 3 volumes for instance.
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.172s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk 1073741824" returned: 0 in 0.064s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Successfully created port: 0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Cannot resize image /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'migration_context' on Instance uuid dcfcdd0b-bff7-40d0-b924-daffc40e43e1 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Ensure instance console log exists: /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.681s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:40 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Deleted allocations for instance 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35
Jul 26 17:01:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed305784-d080-47ee-9d22-7786ca426db9 tempest-TaggedBootDevicesTest_v242-826283036 tempest-TaggedBootDevicesTest_v242-826283036-project-member] Lock "58bf4d75-dfda-4ba8-91bd-5afb2a20ef35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.791s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Successfully updated port: 0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "refresh_cache-dcfcdd0b-bff7-40d0-b924-daffc40e43e1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquired lock "refresh_cache-dcfcdd0b-bff7-40d0-b924-daffc40e43e1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-changed-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Refreshing instance network info cache due to event network-changed-0896e71c-3bc7-4005-8b4f-d24002883a99. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] Acquiring lock "refresh_cache-dcfcdd0b-bff7-40d0-b924-daffc40e43e1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Updating instance_info_cache with network_info: [{"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Releasing lock "refresh_cache-dcfcdd0b-bff7-40d0-b924-daffc40e43e1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Instance network_info: |[{"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] Acquired lock "refresh_cache-dcfcdd0b-bff7-40d0-b924-daffc40e43e1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Refreshing network info cache for port 0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Start _get_guest_xml network_info=[{"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:41 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:01:41 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1736520187',display_name='tempest-VolumesAdminNegativeTest-server-1736520187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1736520187',id=16,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74144c8b9bb4410983f5b3b496a1aa87',ramdisk_id='',reservation_id='r-4k9sbgx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2053670578',owner_user_name='tempest-VolumesAdminNegativeTest-2053670578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:01:40Z,user_data=None,user_id='f4ffde3f244e4ac1923e33f7a9f048ec',uuid=dcfcdd0b-bff7-40d0-b924-daffc40e43e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converting VIF {"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.objects.instance [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'pci_devices' on Instance uuid dcfcdd0b-bff7-40d0-b924-daffc40e43e1 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:01:41 user nova-compute[70594]:   <uuid>dcfcdd0b-bff7-40d0-b924-daffc40e43e1</uuid>
Jul 26 17:01:41 user nova-compute[70594]:   <name>instance-00000010</name>
Jul 26 17:01:41 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:01:41 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:01:41 user nova-compute[70594]:   <metadata>
Jul 26 17:01:41 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:01:41 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:01:41 user nova-compute[70594]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1736520187</nova:name>
Jul 26 17:01:41 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:01:41</nova:creationTime>
Jul 26 17:01:41 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:01:41 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:01:41 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:01:41 user nova-compute[70594]:       <nova:owner>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:user uuid="f4ffde3f244e4ac1923e33f7a9f048ec">tempest-VolumesAdminNegativeTest-2053670578-project-member</nova:user>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:project uuid="74144c8b9bb4410983f5b3b496a1aa87">tempest-VolumesAdminNegativeTest-2053670578</nova:project>
Jul 26 17:01:41 user nova-compute[70594]:       </nova:owner>
Jul 26 17:01:41 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:01:41 user nova-compute[70594]:       <nova:ports>
Jul 26 17:01:41 user nova-compute[70594]:         <nova:port uuid="0896e71c-3bc7-4005-8b4f-d24002883a99">
Jul 26 17:01:41 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 26 17:01:41 user nova-compute[70594]:         </nova:port>
Jul 26 17:01:41 user nova-compute[70594]:       </nova:ports>
Jul 26 17:01:41 user nova-compute[70594]:     </nova:instance>
Jul 26 17:01:41 user nova-compute[70594]:   </metadata>
Jul 26 17:01:41 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:01:41 user nova-compute[70594]:     <system>
Jul 26 17:01:41 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:01:41 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:01:41 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:01:41 user nova-compute[70594]:       <entry name="serial">dcfcdd0b-bff7-40d0-b924-daffc40e43e1</entry>
Jul 26 17:01:41 user nova-compute[70594]:       <entry name="uuid">dcfcdd0b-bff7-40d0-b924-daffc40e43e1</entry>
Jul 26 17:01:41 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:01:41 user nova-compute[70594]:     </system>
Jul 26 17:01:41 user nova-compute[70594]:   </sysinfo>
Jul 26 17:01:41 user nova-compute[70594]:   <os>
Jul 26 17:01:41 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:01:41 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:01:41 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:01:41 user nova-compute[70594]:   </os>
Jul 26 17:01:41 user nova-compute[70594]:   <features>
Jul 26 17:01:41 user nova-compute[70594]:     <acpi/>
Jul 26 17:01:41 user nova-compute[70594]:     <apic/>
Jul 26 17:01:41 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:01:41 user nova-compute[70594]:   </features>
Jul 26 17:01:41 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:01:41 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:01:41 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:01:41 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:01:41 user nova-compute[70594]:   </clock>
Jul 26 17:01:41 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:01:41 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:01:41 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:01:41 user nova-compute[70594]:   </cpu>
Jul 26 17:01:41 user nova-compute[70594]:   <devices>
Jul 26 17:01:41 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:01:41 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:01:41 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk"/>
Jul 26 17:01:41 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:01:41 user nova-compute[70594]:     </disk>
Jul 26 17:01:41 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:01:41 user nova-compute[70594]:       <mac address="fa:16:3e:c1:ae:ac"/>
Jul 26 17:01:41 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:01:41 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:01:41 user nova-compute[70594]:       <target dev="tap0896e71c-3b"/>
Jul 26 17:01:41 user nova-compute[70594]:     </interface>
Jul 26 17:01:41 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:01:41 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/console.log" append="off"/>
Jul 26 17:01:41 user nova-compute[70594]:     </serial>
Jul 26 17:01:41 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:01:41 user nova-compute[70594]:     <video>
Jul 26 17:01:41 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:01:41 user nova-compute[70594]:     </video>
Jul 26 17:01:41 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:01:41 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:01:41 user nova-compute[70594]:     </rng>
Jul 26 17:01:41 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:01:41 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:01:41 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:01:41 user nova-compute[70594]:     </memballoon>
Jul 26 17:01:41 user nova-compute[70594]:   </devices>
Jul 26 17:01:41 user nova-compute[70594]: </domain>
Jul 26 17:01:41 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1736520187',display_name='tempest-VolumesAdminNegativeTest-server-1736520187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1736520187',id=16,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74144c8b9bb4410983f5b3b496a1aa87',ramdisk_id='',reservation_id='r-4k9sbgx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2053670578',owner_user_name='tempest-VolumesAdminNegativeTest-2053670578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:01:40Z,user_data=None,user_id='f4ffde3f244e4ac1923e33f7a9f048ec',uuid=dcfcdd0b-bff7-40d0-b924-daffc40e43e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converting VIF {"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG os_vif [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0896e71c-3b, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0896e71c-3b, col_values=(('external_ids', {'iface-id': '0896e71c-3bc7-4005-8b4f-d24002883a99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ae:ac', 'vm-uuid': 'dcfcdd0b-bff7-40d0-b924-daffc40e43e1'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:41 user nova-compute[70594]: INFO os_vif [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b')
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:01:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] No VIF found with MAC fa:16:3e:c1:ae:ac, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:01:42 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Updated VIF entry in instance network info cache for port 0896e71c-3bc7-4005-8b4f-d24002883a99. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:01:42 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Updating instance_info_cache with network_info: [{"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb3d2a41-fd25-437a-9a64-ee7cc5068a4c req-7772d1af-2393-42b7-9014-edc7df7970e5 service nova] Releasing lock "refresh_cache-dcfcdd0b-bff7-40d0-b924-daffc40e43e1" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-84cef88a-7836-4e1a-a5d9-11d8055ace4a req-f6f03c09-8706-4d63-945b-73e1669873cc service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84cef88a-7836-4e1a-a5d9-11d8055ace4a req-f6f03c09-8706-4d63-945b-73e1669873cc service nova] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84cef88a-7836-4e1a-a5d9-11d8055ace4a req-f6f03c09-8706-4d63-945b-73e1669873cc service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84cef88a-7836-4e1a-a5d9-11d8055ace4a req-f6f03c09-8706-4d63-945b-73e1669873cc service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-84cef88a-7836-4e1a-a5d9-11d8055ace4a req-f6f03c09-8706-4d63-945b-73e1669873cc service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] No waiting events found dispatching network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:43 user nova-compute[70594]: WARNING nova.compute.manager [req-84cef88a-7836-4e1a-a5d9-11d8055ace4a req-f6f03c09-8706-4d63-945b-73e1669873cc service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received unexpected event network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 for instance with vm_state building and task_state spawning.
Jul 26 17:01:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-757fdb1b-0278-4009-b614-74fa9620fbb7 req-f589ee6b-d568-4c29-b298-dcf50d60f127 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-757fdb1b-0278-4009-b614-74fa9620fbb7 req-f589ee6b-d568-4c29-b298-dcf50d60f127 service nova] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-757fdb1b-0278-4009-b614-74fa9620fbb7 req-f589ee6b-d568-4c29-b298-dcf50d60f127 service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-757fdb1b-0278-4009-b614-74fa9620fbb7 req-f589ee6b-d568-4c29-b298-dcf50d60f127 service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-757fdb1b-0278-4009-b614-74fa9620fbb7 req-f589ee6b-d568-4c29-b298-dcf50d60f127 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] No waiting events found dispatching network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:45 user nova-compute[70594]: WARNING nova.compute.manager [req-757fdb1b-0278-4009-b614-74fa9620fbb7 req-f589ee6b-d568-4c29-b298-dcf50d60f127 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received unexpected event network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 for instance with vm_state building and task_state spawning.
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390890.888701, 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:45 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] VM Stopped (Lifecycle Event)
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390905.9128897, dcfcdd0b-bff7-40d0-b924-daffc40e43e1 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:45 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] VM Resumed (Lifecycle Event)
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7c077947-2653-49b5-b7b6-8c3e9ff40fb6 None None] [instance: 58bf4d75-dfda-4ba8-91bd-5afb2a20ef35] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:01:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Instance spawned successfully.
Jul 26 17:01:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:01:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390905.9251444, dcfcdd0b-bff7-40d0-b924-daffc40e43e1 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:01:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] VM Started (Lifecycle Event)
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:01:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:01:46 user nova-compute[70594]: INFO nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Took 6.27 seconds to spawn the instance on the hypervisor.
Jul 26 17:01:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:01:46 user nova-compute[70594]: INFO nova.compute.manager [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Took 7.29 seconds to build instance.
Jul 26 17:01:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-67c8f0ad-9727-4679-9b8f-9629b8eef012 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.415s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:48 user nova-compute[70594]: INFO nova.compute.manager [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Terminating instance
Jul 26 17:01:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-8bcdaf0d-4cf2-4dc6-92a8-2db0ffb343a2 req-8cf857c1-61eb-48a9-89fd-2c0883383c05 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-vif-unplugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8bcdaf0d-4cf2-4dc6-92a8-2db0ffb343a2 req-8cf857c1-61eb-48a9-89fd-2c0883383c05 service nova] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8bcdaf0d-4cf2-4dc6-92a8-2db0ffb343a2 req-8cf857c1-61eb-48a9-89fd-2c0883383c05 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8bcdaf0d-4cf2-4dc6-92a8-2db0ffb343a2 req-8cf857c1-61eb-48a9-89fd-2c0883383c05 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-8bcdaf0d-4cf2-4dc6-92a8-2db0ffb343a2 req-8cf857c1-61eb-48a9-89fd-2c0883383c05 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] No waiting events found dispatching network-vif-unplugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-8bcdaf0d-4cf2-4dc6-92a8-2db0ffb343a2 req-8cf857c1-61eb-48a9-89fd-2c0883383c05 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-vif-unplugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Instance destroyed successfully.
Jul 26 17:01:49 user nova-compute[70594]: DEBUG nova.objects.instance [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lazy-loading 'resources' on Instance uuid afa7d3a7-f79f-4914-a78d-a77b093d1cb1 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1461888267',display_name='tempest-ServersNegativeTestJSON-server-1461888267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1461888267',id=14,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e6ae07082de4f438c3cd0e80c27e39b',ramdisk_id='',reservation_id='r-uul3sn4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1210249454',owner_user_name='tempest-ServersNegativeTestJSON-1210249454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:12Z,user_data=None,user_id='0475b99e94644a248b5a8b934b881c96',uuid=afa7d3a7-f79f-4914-a78d-a77b093d1cb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converting VIF {"id": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "address": "fa:16:3e:b0:5a:95", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9ea0b8-0c", "ovs_interfaceid": "6e9ea0b8-0c26-439c-a81b-c522f8285930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG os_vif [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9ea0b8-0c, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:49 user nova-compute[70594]: INFO os_vif [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5a:95,bridge_name='br-int',has_traffic_filtering=True,id=6e9ea0b8-0c26-439c-a81b-c522f8285930,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9ea0b8-0c')
Jul 26 17:01:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Deleting instance files /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1_del
Jul 26 17:01:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Deletion of /opt/stack/data/nova/instances/afa7d3a7-f79f-4914-a78d-a77b093d1cb1_del complete
Jul 26 17:01:49 user nova-compute[70594]: INFO nova.compute.manager [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 26 17:01:49 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:01:49 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:50 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Took 0.87 seconds to deallocate network for instance.
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-d626d28c-3367-40e8-803e-103bce15f811 req-38fcbcd2-2dc9-4b90-969f-f77dacc352e7 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-vif-deleted-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:50 user nova-compute[70594]: INFO nova.compute.manager [req-d626d28c-3367-40e8-803e-103bce15f811 req-38fcbcd2-2dc9-4b90-969f-f77dacc352e7 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Neutron deleted interface 6e9ea0b8-0c26-439c-a81b-c522f8285930; detaching it from the instance and deleting it from the info cache
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-d626d28c-3367-40e8-803e-103bce15f811 req-38fcbcd2-2dc9-4b90-969f-f77dacc352e7 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-d626d28c-3367-40e8-803e-103bce15f811 req-38fcbcd2-2dc9-4b90-969f-f77dacc352e7 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Detach interface failed, port_id=6e9ea0b8-0c26-439c-a81b-c522f8285930, reason: Instance afa7d3a7-f79f-4914-a78d-a77b093d1cb1 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:50 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Deleted allocations for instance afa7d3a7-f79f-4914-a78d-a77b093d1cb1
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-eafae64c-7046-46ed-9fa4-de208f40bc85 req-5e498450-1fba-4143-a51a-bd3ef0594526 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received event network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eafae64c-7046-46ed-9fa4-de208f40bc85 req-5e498450-1fba-4143-a51a-bd3ef0594526 service nova] Acquiring lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eafae64c-7046-46ed-9fa4-de208f40bc85 req-5e498450-1fba-4143-a51a-bd3ef0594526 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eafae64c-7046-46ed-9fa4-de208f40bc85 req-5e498450-1fba-4143-a51a-bd3ef0594526 service nova] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-eafae64c-7046-46ed-9fa4-de208f40bc85 req-5e498450-1fba-4143-a51a-bd3ef0594526 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] No waiting events found dispatching network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:01:50 user nova-compute[70594]: WARNING nova.compute.manager [req-eafae64c-7046-46ed-9fa4-de208f40bc85 req-5e498450-1fba-4143-a51a-bd3ef0594526 service nova] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Received unexpected event network-vif-plugged-6e9ea0b8-0c26-439c-a81b-c522f8285930 for instance with vm_state deleted and task_state None.
Jul 26 17:01:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c373abb7-1386-4986-8fb0-937c8a8df1fb tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "afa7d3a7-f79f-4914-a78d-a77b093d1cb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:53 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:54 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:57 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:57 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:01:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:57 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG nova.objects.instance [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'flavor' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:01:59 user nova-compute[70594]: INFO nova.compute.manager [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Attaching volume 55bfcd51-531a-48a7-9686-8253637a4d81 to /dev/vdb
Jul 26 17:01:59 user nova-compute[70594]: DEBUG os_brick.utils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482eb3e-b39f-4821-98a6-dda1e749e7b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[487f9372-f110-4c7f-b9ec-0d27179559ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6f5be6-b48a-40a4-a203-36a760c0c586]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaac542-da44-46ce-ba9d-4ea7f8c460c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:01:59 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7322f83-7585-4538-bef8-070a3d9ff433]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG os_brick.utils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating existing volume attachment record: 5107a223-220c-43c2-8502-4dc32e608a13 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:01:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG nova.objects.instance [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'flavor' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:00 user nova-compute[70594]: INFO nova.compute.manager [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Attaching volume aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 to /dev/vdb
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG os_brick.utils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff3b43-4088-4ce4-8e64-5ca4c498d833]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10945a4-cf6e-4219-b05d-ed09493bbad4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa73b963-8f38-4f9d-9aec-aef900a4c7a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a402aa-50bc-465b-911c-397cb4b63417]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:02:00 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dfe692-1b1a-4934-a9c4-5c256621af89]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG os_brick.utils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating existing volume attachment record: e993abba-0ca7-4413-897c-b05e5d32cc68 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.66019058227539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 2c9162fc-40f6-462c-843a-fa279515db41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance dcfcdd0b-bff7-40d0-b924-daffc40e43e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:02:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:03 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390909.1397655, afa7d3a7-f79f-4914-a78d-a77b093d1cb1 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:04 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] VM Stopped (Lifecycle Event)
Jul 26 17:02:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-adaa9124-01e7-4e24-a5b3-04f3a1443493 None None] [instance: afa7d3a7-f79f-4914-a78d-a77b093d1cb1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:02:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQKZyFTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:07 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:07 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:07 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7085853-0459-4d38-83ce-fc6a61781883]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:02:07 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733bb96-1d9e-4c96-989f-246ae2565e44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81] added
Jul 26 17:02:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d73b3a4-e893-4321-ab56-65006766a379]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c623ada-01f8-432d-986a-6ecbd02fad92]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQKZyFTj {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQKZyFTj" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[67442674-e600-4e43-83b9-825ce4e113be]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQKZyFTj'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f3b315-c630-44dd-9e9c-8bd0b687ecae]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9111b-0bad-4b94-bda0-a950d4de3f11]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 26 17:02:07 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 26 17:02:07 user nova-compute[70594]:  {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:07 user nova-compute[70594]: WARNING os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 26 17:02:07 user nova-compute[70594]: 
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52ab80c-4628-4892-9253-7bb5fb86ea80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260]
Jul 26 17:02:07 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260] successful.
Jul 26 17:02:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff2d501-518b-4ecd-96ae-7b4e9b423f4f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a0d01d-cea6-4168-b054-db7bbf34bdb8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866e098-ee88-4da5-9b72-736ac7c795d3]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQKZyFTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:07 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:02:07 user nova-compute[70594]: INFO nova.compute.claims [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Claim successful on node user
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:02:08 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23161343032646233', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161343032646233', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.747s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:08 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:08 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.objects.instance [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'flavor' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[258b6359-dc7e-4282-8bb4-8950f2e168d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:02:08 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:02:08 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:02:08 user nova-compute[70594]:   <source dev="/dev/sdb"/>
Jul 26 17:02:08 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:02:08 user nova-compute[70594]:   <serial>55bfcd51-531a-48a7-9686-8253637a4d81</serial>
Jul 26 17:02:08 user nova-compute[70594]: </disk>
Jul 26 17:02:08 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e6bc8-be9b-4e8c-8dd8-a79540d3a17a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9] added
Jul 26 17:02:08 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac514eb-e619-4487-99f6-6b8f111a2970]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.policy [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '522b55c463ac450ebf618c8fdc44a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549ece99958b4c54a8581fe37b3ced92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a7d4f-9ce9-4cd7-8541-6c0eaab2159c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdcHDxBP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:02:08 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Creating image(s)
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "4f271c86551a0731a423bd2de66b694a74cfa3cd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "4f271c86551a0731a423bd2de66b694a74cfa3cd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdcHDxBP" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d06f9d1-9a88-43f3-982c-31192a12c394]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdcHDxBP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8665a2-1532-4fd3-9061-20c45d6523b6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58e7a4a-29f4-41ab-a380-3ab52989751e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:08 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:08 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae00bc-75e0-45ba-8c62-73cc032f325e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]
Jul 26 17:02:09 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.
Jul 26 17:02:09 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No VIF found with MAC fa:16:3e:71:c3:4d, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e49aa-5565-4011-9e92-2c55822bc9c8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.part --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG nova.virt.images [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] 7dd870d3-b195-43da-a68e-0486554bcd2a was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.part /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da775b-1697-4bd8-9b0b-8ffad0877bcb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:09 user nova-compute[70594]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:09 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:09 user nova-compute[70594]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:09 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.697s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b6297-87dc-4ee0-9948-a0e8892fd644]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-63edccd7-8326-416b-8eb6-6e348f8df5bc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.901s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.part /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.converted" returned: 0 in 0.425s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:09 user nova-compute[70594]: INFO nova.compute.manager [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Unshelving
Jul 26 17:02:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Successfully created port: f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "4f271c86551a0731a423bd2de66b694a74cfa3cd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.127s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: INFO nova.virt.block_device [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Booting with volume 166a5665-5d42-4e94-ab45-431bfcb60992 at /dev/vdc
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "4f271c86551a0731a423bd2de66b694a74cfa3cd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "4f271c86551a0731a423bd2de66b694a74cfa3cd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.utils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[384aef23-19b3-4b7e-b1a2-b34d22441d3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b070888e-db14-4b22-9bb8-5fb5a6b11ace]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cd7d73-0b28-4bc0-9027-8baba8c236ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff95b968-6441-4340-9cce-6854a1583ad4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd,backing_fmt=raw /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:02:09 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:02:09 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3928de-a4ec-4a67-a87a-451b5f2908ed]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_brick.utils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating existing volume attachment record: 0bf7f900-74fb-4dea-a83f-7b2b8549ccf1 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd,backing_fmt=raw /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk 1073741824" returned: 0 in 0.078s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "4f271c86551a0731a423bd2de66b694a74cfa3cd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.751s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== connect_volume: return (2499ms) {'type': 'block', 'scsi_wwn': '23530626331663662', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530626331663662', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'flavor' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:02:10 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:02:10 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:02:10 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:02:10 user nova-compute[70594]:   <serial>aa9af32a-f17c-4993-b3b2-9b1e89a6aac9</serial>
Jul 26 17:02:10 user nova-compute[70594]: </disk>
Jul 26 17:02:10 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Cannot resize image /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'migration_context' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Ensure instance console log exists: /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Successfully updated port: f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing instance network info cache due to event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No VIF found with MAC fa:16:3e:be:a5:cb, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:10 user nova-compute[70594]: INFO nova.compute.manager [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Rescuing
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance network_info: |[{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.neutron [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Start _get_guest_xml network_info=[{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T17:02:04Z,direct_url=<?>,disk_format='qcow2',id=7dd870d3-b195-43da-a68e-0486554bcd2a,min_disk=0,min_ram=0,name='tempest-scenario-img--1385308615',owner='549ece99958b4c54a8581fe37b3ced92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T17:02:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '7dd870d3-b195-43da-a68e-0486554bcd2a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:10 user nova-compute[70594]: INFO nova.compute.manager [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Terminating instance
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:02:10 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:10 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T17:02:04Z,direct_url=<?>,disk_format='qcow2',id=7dd870d3-b195-43da-a68e-0486554bcd2a,min_disk=0,min_ram=0,name='tempest-scenario-img--1385308615',owner='549ece99958b4c54a8581fe37b3ced92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T17:02:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-176363728',display_name='tempest-TestMinimumBasicScenario-server-176363728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-176363728',id=17,image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGke9iGOmvPqEKSh8QBz1Y0ruHXz1mdEoX5DAbsPsnYZuvHXRd09xN4lqJBepSsaJis60tn6XsdQ5erG81wBPM++LllZP3o1etQSYkKxJFvxlgTcLjIpEDXYCKw7/29ccQ==',key_name='tempest-TestMinimumBasicScenario-1758624021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-b7tjwa5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:08Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=76a02a97-4400-44d2-8655-89fc12f69682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:10 user nova-compute[70594]:   <uuid>76a02a97-4400-44d2-8655-89fc12f69682</uuid>
Jul 26 17:02:10 user nova-compute[70594]:   <name>instance-00000011</name>
Jul 26 17:02:10 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:02:10 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:10 user nova-compute[70594]:   <metadata>
Jul 26 17:02:10 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:10 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:10 user nova-compute[70594]:       <nova:name>tempest-TestMinimumBasicScenario-server-176363728</nova:name>
Jul 26 17:02:10 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:10</nova:creationTime>
Jul 26 17:02:10 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:02:10 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:10 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:10 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:user uuid="522b55c463ac450ebf618c8fdc44a8b5">tempest-TestMinimumBasicScenario-1770089512-project-member</nova:user>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:project uuid="549ece99958b4c54a8581fe37b3ced92">tempest-TestMinimumBasicScenario-1770089512</nova:project>
Jul 26 17:02:10 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:10 user nova-compute[70594]:       <nova:root type="image" uuid="7dd870d3-b195-43da-a68e-0486554bcd2a"/>
Jul 26 17:02:10 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:10 user nova-compute[70594]:         <nova:port uuid="f40ec4be-97e7-4bdf-a1aa-0be24286854b">
Jul 26 17:02:10 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 26 17:02:10 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:10 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:10 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:10 user nova-compute[70594]:   </metadata>
Jul 26 17:02:10 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:10 user nova-compute[70594]:     <system>
Jul 26 17:02:10 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:10 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:10 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:10 user nova-compute[70594]:       <entry name="serial">76a02a97-4400-44d2-8655-89fc12f69682</entry>
Jul 26 17:02:10 user nova-compute[70594]:       <entry name="uuid">76a02a97-4400-44d2-8655-89fc12f69682</entry>
Jul 26 17:02:10 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:10 user nova-compute[70594]:     </system>
Jul 26 17:02:10 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:10 user nova-compute[70594]:   <os>
Jul 26 17:02:10 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:10 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:02:10 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:10 user nova-compute[70594]:   </os>
Jul 26 17:02:10 user nova-compute[70594]:   <features>
Jul 26 17:02:10 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:10 user nova-compute[70594]:     <apic/>
Jul 26 17:02:10 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:10 user nova-compute[70594]:   </features>
Jul 26 17:02:10 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:10 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:10 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:10 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:10 user nova-compute[70594]:   </clock>
Jul 26 17:02:10 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:10 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:10 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:10 user nova-compute[70594]:   </cpu>
Jul 26 17:02:10 user nova-compute[70594]:   <devices>
Jul 26 17:02:10 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:10 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:10 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk"/>
Jul 26 17:02:10 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:10 user nova-compute[70594]:     </disk>
Jul 26 17:02:10 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:10 user nova-compute[70594]:       <mac address="fa:16:3e:70:78:e9"/>
Jul 26 17:02:10 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:10 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:10 user nova-compute[70594]:       <target dev="tapf40ec4be-97"/>
Jul 26 17:02:10 user nova-compute[70594]:     </interface>
Jul 26 17:02:10 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:10 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/console.log" append="off"/>
Jul 26 17:02:10 user nova-compute[70594]:     </serial>
Jul 26 17:02:10 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:10 user nova-compute[70594]:     <video>
Jul 26 17:02:10 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:10 user nova-compute[70594]:     </video>
Jul 26 17:02:10 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:10 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:10 user nova-compute[70594]:     </rng>
Jul 26 17:02:10 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:10 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:10 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:10 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:10 user nova-compute[70594]:   </devices>
Jul 26 17:02:10 user nova-compute[70594]: </domain>
Jul 26 17:02:10 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-176363728',display_name='tempest-TestMinimumBasicScenario-server-176363728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-176363728',id=17,image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGke9iGOmvPqEKSh8QBz1Y0ruHXz1mdEoX5DAbsPsnYZuvHXRd09xN4lqJBepSsaJis60tn6XsdQ5erG81wBPM++LllZP3o1etQSYkKxJFvxlgTcLjIpEDXYCKw7/29ccQ==',key_name='tempest-TestMinimumBasicScenario-1758624021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-b7tjwa5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:08Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=76a02a97-4400-44d2-8655-89fc12f69682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG os_vif [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf40ec4be-97, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf40ec4be-97, col_values=(('external_ids', {'iface-id': 'f40ec4be-97e7-4bdf-a1aa-0be24286854b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:78:e9', 'vm-uuid': '76a02a97-4400-44d2-8655-89fc12f69682'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-04b01bae-a80c-432f-8245-f75f3c30dc74 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.628s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:11 user nova-compute[70594]: INFO os_vif [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97')
Jul 26 17:02:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No VIF found with MAC fa:16:3e:70:78:e9, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-f3ed77b4-f250-4395-8ead-d6ec2e137251 req-af2a4be6-fe9c-4610-9de5-f76a78e14052 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-vif-unplugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f3ed77b4-f250-4395-8ead-d6ec2e137251 req-af2a4be6-fe9c-4610-9de5-f76a78e14052 service nova] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f3ed77b4-f250-4395-8ead-d6ec2e137251 req-af2a4be6-fe9c-4610-9de5-f76a78e14052 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f3ed77b4-f250-4395-8ead-d6ec2e137251 req-af2a4be6-fe9c-4610-9de5-f76a78e14052 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-f3ed77b4-f250-4395-8ead-d6ec2e137251 req-af2a4be6-fe9c-4610-9de5-f76a78e14052 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] No waiting events found dispatching network-vif-unplugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-f3ed77b4-f250-4395-8ead-d6ec2e137251 req-af2a4be6-fe9c-4610-9de5-f76a78e14052 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-vif-unplugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updated VIF entry in instance network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-29403bc3-919b-44d6-a905-1e72e7a37e6a req-40da257b-d59d-4fa1-9dbc-42bd07eb517c service nova] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Instance destroyed successfully.
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.objects.instance [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lazy-loading 'resources' on Instance uuid 2c9162fc-40f6-462c-843a-fa279515db41 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-684046493',display_name='tempest-TestVolumeSwap-server-684046493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-684046493',id=10,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBz6vHObzeuvB9s0XHdSgr8PRdnxTguPwynIKN0tb54q+fXxz9I5b+yNz+8qyuVfEvdp4VgKu0uFFkX384juCNaiPvtP7+zKoAuHiyen56RI83MC+TjqYfllMtQs7dJOw==',key_name='tempest-keypair-705765736',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6da82b9f34b44fbba544f0bdc2b9d8b8',ramdisk_id='',reservation_id='r-epgn06x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1295928460',owner_user_name='tempest-TestVolumeSwap-1295928460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T16:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='144454f557ab457f90a4d0d382fc3aad',uuid=2c9162fc-40f6-462c-843a-fa279515db41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Converting VIF {"id": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "address": "fa:16:3e:1f:9e:53", "network": {"id": "5c75a05e-74d5-49b4-8cd4-5967e3be394b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-489857093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da82b9f34b44fbba544f0bdc2b9d8b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81cc8f4-fa", "ovs_interfaceid": "f81cc8f4-fa56-4da2-994b-31b53dc46242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG os_vif [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf81cc8f4-fa, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: INFO os_vif [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:9e:53,bridge_name='br-int',has_traffic_filtering=True,id=f81cc8f4-fa56-4da2-994b-31b53dc46242,network=Network(5c75a05e-74d5-49b4-8cd4-5967e3be394b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf81cc8f4-fa')
Jul 26 17:02:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Deleting instance files /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41_del
Jul 26 17:02:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Deletion of /opt/stack/data/nova/instances/2c9162fc-40f6-462c-843a-fa279515db41_del complete
Jul 26 17:02:12 user nova-compute[70594]: INFO nova.compute.manager [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Took 1.79 seconds to destroy the instance on the hypervisor.
Jul 26 17:02:12 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-2be3fec2-6edb-4d3f-a51d-56d5a94e0a01 req-f77bdbf5-799e-4532-9f02-2427465676c3 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2be3fec2-6edb-4d3f-a51d-56d5a94e0a01 req-f77bdbf5-799e-4532-9f02-2427465676c3 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2be3fec2-6edb-4d3f-a51d-56d5a94e0a01 req-f77bdbf5-799e-4532-9f02-2427465676c3 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2be3fec2-6edb-4d3f-a51d-56d5a94e0a01 req-f77bdbf5-799e-4532-9f02-2427465676c3 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-2be3fec2-6edb-4d3f-a51d-56d5a94e0a01 req-f77bdbf5-799e-4532-9f02-2427465676c3 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:13 user nova-compute[70594]: WARNING nova.compute.manager [req-2be3fec2-6edb-4d3f-a51d-56d5a94e0a01 req-f77bdbf5-799e-4532-9f02-2427465676c3 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state active and task_state rescuing.
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Stashing vm_state: active {{(pid=70594) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'pci_requests' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:02:13 user nova-compute[70594]: INFO nova.compute.claims [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Claim successful on node user
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'resources' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'pci_devices' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance destroyed successfully.
Jul 26 17:02:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Attempting a stable device rescue
Jul 26 17:02:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70594) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:02:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Creating image(s)
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:13 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating resource usage from migration 6693ef55-1704-409b-875a-29c0b64b6407
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "006ef5c321889d8b20c6b01834023164e4e3928a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "006ef5c321889d8b20c6b01834023164e4e3928a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] Acquiring lock "2c9162fc-40f6-462c-843a-fa279515db41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] Lock "2c9162fc-40f6-462c-843a-fa279515db41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] No waiting events found dispatching network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:13 user nova-compute[70594]: WARNING nova.compute.manager [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received unexpected event network-vif-plugged-f81cc8f4-fa56-4da2-994b-31b53dc46242 for instance with vm_state active and task_state deleting.
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:13 user nova-compute[70594]: WARNING nova.compute.manager [req-3048a11a-4341-444f-84de-70cd39d3d445 req-f83a6247-4ac2-466d-95bb-90bf84b88309 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state building and task_state spawning.
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:15 user nova-compute[70594]: WARNING nova.compute.manager [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state active and task_state rescuing.
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Received event network-vif-deleted-f81cc8f4-fa56-4da2-994b-31b53dc46242 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:15 user nova-compute[70594]: INFO nova.compute.manager [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Neutron deleted interface f81cc8f4-fa56-4da2-994b-31b53dc46242; detaching it from the instance and deleting it from the info cache
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.network.neutron [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:15 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Took 2.47 seconds to deallocate network for instance.
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4a240c9-818e-4f8d-8b83-195e93909853 req-26534200-ae75-4571-8507-ed3b04010e60 service nova] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Detach interface failed, port_id=f81cc8f4-fa56-4da2-994b-31b53dc46242, reason: Instance 2c9162fc-40f6-462c-843a-fa279515db41 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.part --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.virt.images [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] aec9deb8-5302-421b-ba06-8e000f9bea4d was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.part /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.956s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:15 user nova-compute[70594]: INFO nova.compute.manager [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Migrating
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.344s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:15 user nova-compute[70594]: INFO nova.compute.rpcapi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:15 user nova-compute[70594]: DEBUG nova.network.neutron [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.part /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.converted" returned: 0 in 0.780s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-ea63d8af-dee6-4b4e-a6aa-fc9a31b0ae52 req-ce88172a-1d99-478c-b940-9527e766a93b service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ea63d8af-dee6-4b4e-a6aa-fc9a31b0ae52 req-ce88172a-1d99-478c-b940-9527e766a93b service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ea63d8af-dee6-4b4e-a6aa-fc9a31b0ae52 req-ce88172a-1d99-478c-b940-9527e766a93b service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ea63d8af-dee6-4b4e-a6aa-fc9a31b0ae52 req-ce88172a-1d99-478c-b940-9527e766a93b service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-ea63d8af-dee6-4b4e-a6aa-fc9a31b0ae52 req-ce88172a-1d99-478c-b940-9527e766a93b service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:16 user nova-compute[70594]: WARNING nova.compute.manager [req-ea63d8af-dee6-4b4e-a6aa-fc9a31b0ae52 req-ce88172a-1d99-478c-b940-9527e766a93b service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state building and task_state spawning.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390936.1201236, 76a02a97-4400-44d2-8655-89fc12f69682 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] VM Resumed (Lifecycle Event)
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance spawned successfully.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390936.1207516, 76a02a97-4400-44d2-8655-89fc12f69682 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] VM Started (Lifecycle Event)
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "006ef5c321889d8b20c6b01834023164e4e3928a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.376s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "006ef5c321889d8b20c6b01834023164e4e3928a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "006ef5c321889d8b20c6b01834023164e4e3928a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Took 7.80 seconds to spawn the instance on the hypervisor.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.compute.manager [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Took 8.67 seconds to build instance.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.877s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a --force-share --output=json" returned: 0 in 0.214s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a,backing_fmt=raw /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a40f0bde-c0f8-41f5-a3d0-e33db52c3454 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.824s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/006ef5c321889d8b20c6b01834023164e4e3928a,backing_fmt=raw /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue" returned: 0 in 0.054s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "006ef5c321889d8b20c6b01834023164e4e3928a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'migration_context' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:16 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Deleted allocations for instance 2c9162fc-40f6-462c-843a-fa279515db41
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Start _get_guest_xml network_info=[{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "vif_mac": "fa:16:3e:71:c3:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aec9deb8-5302-421b-ba06-8e000f9bea4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQKZyFTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3f5841c2-e400-48d9-92dd-d776150c7849', 'attached_at': '', 'detached_at': '', 'volume_id': '55bfcd51-531a-48a7-9686-8253637a4d81', 'serial': '55bfcd51-531a-48a7-9686-8253637a4d81'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '5107a223-220c-43c2-8502-4dc32e608a13', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'resources' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:16 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:16 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQKZyFTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:16 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:16 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:16 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c2b56111-1983-42bd-90a8-f8a8d2cdc0e0 tempest-TestVolumeSwap-1295928460 tempest-TestVolumeSwap-1295928460-project-member] Lock "2c9162fc-40f6-462c-843a-fa279515db41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.835s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[366e3184-c5e5-46de-93c0-8d52711aad19]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WQKZyFTj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 26 17:02:16 user nova-compute[70594]: node.name = iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:02:16 user nova-compute[70594]: node.tpgt = -1
Jul 26 17:02:16 user nova-compute[70594]: node.startup = automatic
Jul 26 17:02:16 user nova-compute[70594]: node.leading_login = No
Jul 26 17:02:16 user nova-compute[70594]: iface.iscsi_ifacename = default
Jul 26 17:02:16 user nova-compute[70594]: iface.net_ifacename = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.ipaddress = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.prefix_len = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.hwaddress = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.transport_name = tcp
Jul 26 17:02:16 user nova-compute[70594]: iface.initiatorname = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.vlan_id = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.vlan_priority = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.vlan_state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.iface_num = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.mtu = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.port = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.bootproto = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.subnet_mask = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.gateway = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_alt_client_id_state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_alt_client_id = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_dns = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_learn_iqn = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_req_vendor_id_state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_vendor_id_state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_vendor_id = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.dhcp_slp_da = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.fragmentation = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.gratuitous_arp = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.incoming_forwarding = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.tos_state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.tos = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.ttl = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.delayed_ack = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.tcp_nagle = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.tcp_wsf_state = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.tcp_wsf = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.tcp_timer_scale = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.tcp_timestamp = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.redirect = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.def_task_mgmt_timeout = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.header_digest = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.data_digest = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.immediate_data = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.initial_r2t = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.data_seq_inorder = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.data_pdu_inorder = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.erl = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.max_receive_data_len = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.first_burst_len = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.max_outstanding_r2t = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.max_burst_len = 0
Jul 26 17:02:16 user nova-compute[70594]: iface.chap_auth = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.bidi_chap = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.strict_login_compliance = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.discovery_auth = <empty>
Jul 26 17:02:16 user nova-compute[70594]: iface.discovery_logout = <empty>
Jul 26 17:02:16 user nova-compute[70594]: node.discovery_address = <empty>
Jul 26 17:02:16 user nova-compute[70594]: node.discovery_port = 0
Jul 26 17:02:16 user nova-compute[70594]: node.discovery_type = static
Jul 26 17:02:16 user nova-compute[70594]: node.session.initial_cmdsn = 0
Jul 26 17:02:16 user nova-compute[70594]: node.session.initial_login_retry_max = 8
Jul 26 17:02:16 user nova-compute[70594]: node.session.xmit_thread_priority = -20
Jul 26 17:02:16 user nova-compute[70594]: node.session.cmds_max = 128
Jul 26 17:02:16 user nova-compute[70594]: node.session.queue_depth = 32
Jul 26 17:02:16 user nova-compute[70594]: node.session.nr_sessions = 1
Jul 26 17:02:16 user nova-compute[70594]: node.session.auth.authmethod = CHAP
Jul 26 17:02:16 user nova-compute[70594]: node.session.auth.username = WQKZyFTj
Jul 26 17:02:16 user nova-compute[70594]: node.session.auth.password = ***
Jul 26 17:02:16 user nova-compute[70594]: node.session.auth.username_in = <empty>
Jul 26 17:02:16 user nova-compute[70594]: node.session.auth.password_in = <empty>
Jul 26 17:02:16 user nova-compute[70594]: node.session.auth.chap_algs = MD5
Jul 26 17:02:16 user nova-compute[70594]: node.session.timeo.replacement_timeout = 120
Jul 26 17:02:16 user nova-compute[70594]: node.session.err_timeo.abort_timeout = 15
Jul 26 17:02:16 user nova-compute[70594]: node.session.err_timeo.lu_reset_timeout = 30
Jul 26 17:02:16 user nova-compute[70594]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 26 17:02:16 user nova-compute[70594]: node.session.err_timeo.host_reset_timeout = 60
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.FastAbort = Yes
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.InitialR2T = No
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.ImmediateData = Yes
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.FirstBurstLength = 262144
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.MaxBurstLength = 16776192
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.DefaultTime2Retain = 0
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.DefaultTime2Wait = 2
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.MaxConnections = 1
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 26 17:02:16 user nova-compute[70594]: node.session.iscsi.ERL = 0
Jul 26 17:02:16 user nova-compute[70594]: node.session.scan = manual
Jul 26 17:02:16 user nova-compute[70594]: node.session.reopen_max = 0
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].address = 172.16.0.220
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].port = 3260
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].startup = manual
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].tcp.window_size = 524288
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].tcp.type_of_service = 0
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].timeo.logout_timeout = 15
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].timeo.login_timeout = 15
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].timeo.auth_timeout = 45
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].timeo.noop_out_interval = 5
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].timeo.noop_out_timeout = 5
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].iscsi.HeaderDigest = None
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].iscsi.DataDigest = None
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].iscsi.IFMarker = No
Jul 26 17:02:16 user nova-compute[70594]: node.conn[0].iscsi.OFMarker = No
Jul 26 17:02:16 user nova-compute[70594]: # END RECORD
Jul 26 17:02:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7145466-ae27-4454-b8b1-d8ce3161a491]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ac0007-91d2-4ce2-99cc-2e3d55d0eb2b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQKZyFTj {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQKZyFTj" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c3427-ed96-4d25-b1a9-74286733667a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQKZyFTj'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd6fa95-d48f-4bd5-b6b3-ca56a0a79215]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[00284c32-f086-4560-9bb3-090cbc9e36f2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:16 user nova-compute[70594]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:16 user nova-compute[70594]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.183s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[248805b5-3cd1-44f8-b800-26bad88ae955]: (4, ('0 0 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQKZyFTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.221s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] <== connect_volume: return (223ms) {'type': 'block', 'scsi_wwn': '23161343032646233', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161343032646233', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-961710201',display_name='tempest-ServerStableDeviceRescueTest-server-961710201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-961710201',id=5,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpQybbYth7qArntY2y7E3HyZ9i+RshZoLnj2sKjelEF04rnuFNHD3e0iuWndaLHwqvKxmXjAggVEmdBbCrxrzpCYISl7Io+U2io7MbvEE2otw7D6PrY/jIvF2m9oMpFEA==',key_name='tempest-keypair-167561146',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae951bdcec3747a2a9fdd2f2ce28d3f0',ramdisk_id='',reservation_id='r-6zptpueb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-263207676',owner_user_name='tempest-ServerStableDeviceRescueTest-263207676-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d46824c7e6747fd8ab11c920e79a58e',uuid=3f5841c2-e400-48d9-92dd-d776150c7849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "vif_mac": "fa:16:3e:71:c3:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converting VIF {"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "vif_mac": "fa:16:3e:71:c3:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:16 user nova-compute[70594]:   <uuid>3f5841c2-e400-48d9-92dd-d776150c7849</uuid>
Jul 26 17:02:16 user nova-compute[70594]:   <name>instance-00000005</name>
Jul 26 17:02:16 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:02:16 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:16 user nova-compute[70594]:   <metadata>
Jul 26 17:02:16 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:16 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:16 user nova-compute[70594]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-961710201</nova:name>
Jul 26 17:02:16 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:16</nova:creationTime>
Jul 26 17:02:16 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:02:16 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:16 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:16 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:user uuid="4d46824c7e6747fd8ab11c920e79a58e">tempest-ServerStableDeviceRescueTest-263207676-project-member</nova:user>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:project uuid="ae951bdcec3747a2a9fdd2f2ce28d3f0">tempest-ServerStableDeviceRescueTest-263207676</nova:project>
Jul 26 17:02:16 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:16 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:02:16 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:16 user nova-compute[70594]:         <nova:port uuid="f057bd54-b76f-4591-a8a7-b97bdb536421">
Jul 26 17:02:16 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:02:16 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:16 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:16 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:16 user nova-compute[70594]:   </metadata>
Jul 26 17:02:16 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:16 user nova-compute[70594]:     <system>
Jul 26 17:02:16 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:16 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:16 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:16 user nova-compute[70594]:       <entry name="serial">3f5841c2-e400-48d9-92dd-d776150c7849</entry>
Jul 26 17:02:16 user nova-compute[70594]:       <entry name="uuid">3f5841c2-e400-48d9-92dd-d776150c7849</entry>
Jul 26 17:02:16 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:16 user nova-compute[70594]:     </system>
Jul 26 17:02:16 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:16 user nova-compute[70594]:   <os>
Jul 26 17:02:16 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:16 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:16 user nova-compute[70594]:   </os>
Jul 26 17:02:16 user nova-compute[70594]:   <features>
Jul 26 17:02:16 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:16 user nova-compute[70594]:     <apic/>
Jul 26 17:02:16 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:16 user nova-compute[70594]:   </features>
Jul 26 17:02:16 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:16 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:16 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:16 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:16 user nova-compute[70594]:   </clock>
Jul 26 17:02:16 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:16 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:16 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:16 user nova-compute[70594]:   </cpu>
Jul 26 17:02:16 user nova-compute[70594]:   <devices>
Jul 26 17:02:16 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:16 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:16 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk"/>
Jul 26 17:02:16 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:16 user nova-compute[70594]:     </disk>
Jul 26 17:02:16 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:02:16 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:02:16 user nova-compute[70594]:       <source dev="/dev/sdb"/>
Jul 26 17:02:16 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:02:16 user nova-compute[70594]:       <serial>55bfcd51-531a-48a7-9686-8253637a4d81</serial>
Jul 26 17:02:16 user nova-compute[70594]:     </disk>
Jul 26 17:02:16 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:16 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:16 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue"/>
Jul 26 17:02:16 user nova-compute[70594]:       <target dev="vdc" bus="virtio"/>
Jul 26 17:02:16 user nova-compute[70594]:       <boot order="1"/>
Jul 26 17:02:16 user nova-compute[70594]:     </disk>
Jul 26 17:02:16 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:16 user nova-compute[70594]:       <mac address="fa:16:3e:71:c3:4d"/>
Jul 26 17:02:16 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:16 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:16 user nova-compute[70594]:       <target dev="tapf057bd54-b7"/>
Jul 26 17:02:16 user nova-compute[70594]:     </interface>
Jul 26 17:02:16 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:16 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/console.log" append="off"/>
Jul 26 17:02:16 user nova-compute[70594]:     </serial>
Jul 26 17:02:16 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:16 user nova-compute[70594]:     <video>
Jul 26 17:02:16 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:16 user nova-compute[70594]:     </video>
Jul 26 17:02:16 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:16 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:16 user nova-compute[70594]:     </rng>
Jul 26 17:02:16 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:16 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:16 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:16 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:16 user nova-compute[70594]:   </devices>
Jul 26 17:02:16 user nova-compute[70594]: </domain>
Jul 26 17:02:16 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance destroyed successfully.
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Starting migrate_disk_and_power_off {{(pid=70594) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] No VIF found with MAC fa:16:3e:71:c3:4d, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-2fa129b5-e473-46ce-bb7d-60437ac8672a req-6d6b5ed6-89a3-458a-b56f-c19853122722 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2fa129b5-e473-46ce-bb7d-60437ac8672a req-6d6b5ed6-89a3-458a-b56f-c19853122722 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2fa129b5-e473-46ce-bb7d-60437ac8672a req-6d6b5ed6-89a3-458a-b56f-c19853122722 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2fa129b5-e473-46ce-bb7d-60437ac8672a req-6d6b5ed6-89a3-458a-b56f-c19853122722 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-2fa129b5-e473-46ce-bb7d-60437ac8672a req-6d6b5ed6-89a3-458a-b56f-c19853122722 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:17 user nova-compute[70594]: WARNING nova.compute.manager [req-2fa129b5-e473-46ce-bb7d-60437ac8672a req-6d6b5ed6-89a3-458a-b56f-c19853122722 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state active and task_state resize_migrating.
Jul 26 17:02:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'pci_requests' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'numa_topology' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:02:18 user nova-compute[70594]: INFO nova.compute.claims [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Claim successful on node user
Jul 26 17:02:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance destroyed successfully.
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87faecb4-e1, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:18 user nova-compute[70594]: INFO os_vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1')
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:18 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c0967-1625-4cec-95af-4123e201b1e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:02:18 user nova-compute[70594]: No targets found.
Jul 26 17:02:18 user nova-compute[70594]: iSNS:
Jul 26 17:02:18 user nova-compute[70594]: No targets found.
Jul 26 17:02:18 user nova-compute[70594]: STATIC:
Jul 26 17:02:18 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:02:18 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:02:18 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:02:18 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:02:18 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:02:18 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:02:18 user nova-compute[70594]: FIRMWARE:
Jul 26 17:02:18 user nova-compute[70594]: No targets found.
Jul 26 17:02:18 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:02:18 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:02:18 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148b060-04cf-45a1-90de-092abdd894ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d80e2fe-7e6e-43ee-bb60-a39ef5eccc41]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:18 user nova-compute[70594]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:18 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:18 user nova-compute[70594]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:18 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910256dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b54753-2392-4464-ac8b-2fd561281889]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b575cb-7c9d-4213-8cd3-a547814d0eb0]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108e521-2c8a-46c4-bc61-ab6dcbfdaa6f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ba071-603d-4d63-b5b0-774560cf2c52]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc53aa6e-e44a-4ebf-bbec-ec74faddd9d1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c87fc-705c-4176-95f2-e2238b8bd091]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]
Jul 26 17:02:18 user nova-compute[70594]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.
Jul 26 17:02:18 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b10ef-788c-434a-9053-0cea8702dccc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== disconnect_volume: return (378ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:18 user nova-compute[70594]: INFO nova.network.neutron [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating port 58242289-8f80-4512-8cdb-0847afd81d42 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9_resize/disk /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "cp -r /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9_resize/disk /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk" returned: 0 in 0.435s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9_resize/disk.info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk.info {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "cp -r /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9_resize/disk.info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk.info" returned: 0 in 0.046s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-7c7bc41f-e481-4ec2-b353-3b3d26411bdd req-14fb6248-2e33-4f96-a6fb-aacdba27d4a4 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7c7bc41f-e481-4ec2-b353-3b3d26411bdd req-14fb6248-2e33-4f96-a6fb-aacdba27d4a4 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7c7bc41f-e481-4ec2-b353-3b3d26411bdd req-14fb6248-2e33-4f96-a6fb-aacdba27d4a4 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7c7bc41f-e481-4ec2-b353-3b3d26411bdd req-14fb6248-2e33-4f96-a6fb-aacdba27d4a4 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-7c7bc41f-e481-4ec2-b353-3b3d26411bdd req-14fb6248-2e33-4f96-a6fb-aacdba27d4a4 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:19 user nova-compute[70594]: WARNING nova.compute.manager [req-7c7bc41f-e481-4ec2-b353-3b3d26411bdd req-14fb6248-2e33-4f96-a6fb-aacdba27d4a4 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state active and task_state resize_migrating.
Jul 26 17:02:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-efd075c5-4a03-4f6f-a406-742a74f2c914 req-3210b357-3b27-47fd-be53-59193483bb95 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-efd075c5-4a03-4f6f-a406-742a74f2c914 req-3210b357-3b27-47fd-be53-59193483bb95 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-efd075c5-4a03-4f6f-a406-742a74f2c914 req-3210b357-3b27-47fd-be53-59193483bb95 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-efd075c5-4a03-4f6f-a406-742a74f2c914 req-3210b357-3b27-47fd-be53-59193483bb95 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-efd075c5-4a03-4f6f-a406-742a74f2c914 req-3210b357-3b27-47fd-be53-59193483bb95 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:19 user nova-compute[70594]: WARNING nova.compute.manager [req-efd075c5-4a03-4f6f-a406-742a74f2c914 req-3210b357-3b27-47fd-be53-59193483bb95 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state active and task_state rescuing.
Jul 26 17:02:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Port 87faecb4-e13b-455f-911b-2c9f9e614336 binding to destination host user is already ACTIVE {{(pid=70594) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:02:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Creating image(s)
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "b6a05851db529a53500f13b858e46d5cdb0d524e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "b6a05851db529a53500f13b858e46d5cdb0d524e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:22 user nova-compute[70594]: WARNING nova.compute.manager [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state active and task_state rescuing.
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-changed-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing instance network info cache due to event network-changed-58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] Acquiring lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] Acquired lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Refreshing network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 3f5841c2-e400-48d9-92dd-d776150c7849 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390941.5816302, 3f5841c2-e400-48d9-92dd-d776150c7849 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Resumed (Lifecycle Event)
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-046cdf4f-5ab7-4bd3-9ff7-5edd3aaa3feb tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.part --force-share --output=json" returned: 0 in 0.174s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.virt.images [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] f5276db9-43a1-4fd5-a06b-bec113e04585 was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.part /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390941.5831707, 3f5841c2-e400-48d9-92dd-d776150c7849 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Started (Lifecycle Event)
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.part /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.converted" returned: 0 in 0.201s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "b6a05851db529a53500f13b858e46d5cdb0d524e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.571s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "b6a05851db529a53500f13b858e46d5cdb0d524e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "b6a05851db529a53500f13b858e46d5cdb0d524e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG os_brick.utils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd1159-f11e-4638-93a7-f379a15e6a6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad8ddd-809f-410c-9753-4e6070799d1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee26194-bd1a-402c-9129-ababb463e5c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf80201-b475-4961-8014-50cf9595dfa8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e --force-share --output=json" returned: 0 in 0.190s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e,backing_fmt=raw /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:02:23 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4577360a-ef5c-4823-b5d0-130935222954]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG os_brick.utils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e,backing_fmt=raw /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk 1073741824" returned: 0 in 0.065s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "b6a05851db529a53500f13b858e46d5cdb0d524e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6a05851db529a53500f13b858e46d5cdb0d524e --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'migration_context' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:23 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Rebasing disk image.
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b -F raw /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updated VIF entry in instance network info cache for port 58242289-8f80-4512-8cdb-0847afd81d42. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:02:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-096044b8-ebdd-48d2-a006-9769267e4458 req-2fadbc20-f842-43ef-8b94-5dfebf600961 service nova] Releasing lock "refresh_cache-ae56085e-6a66-494f-9ec0-2397ec7eb4b0" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:02:24 user nova-compute[70594]: INFO nova.compute.claims [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Claim successful on node user
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:02:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.policy [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '472502ad99de4e669f2adb09afefe2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae4c76df80df42b0b4744e11d2f61b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:02:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Creating image(s)
Jul 26 17:02:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.264s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.347s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b -F raw /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk" returned: 0 in 3.297s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Ensure instance console log exists: /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Start _get_guest_xml network_info=[{"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1f95d63abd36b28c211d50cea3a8917c',container_format='bare',created_at=2023-07-26T17:00:17Z,direct_url=<?>,disk_format='qcow2',id=f5276db9-43a1-4fd5-a06b-bec113e04585,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-932025414-shelved',owner='f389f41a191747e68ceeb776fdcbff40',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-26T17:00:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbXNqrKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ae56085e-6a66-494f-9ec0-2397ec7eb4b0', 'attached_at': '', 'detached_at': '', 'volume_id': '166a5665-5d42-4e94-ab45-431bfcb60992', 'serial': '166a5665-5d42-4e94-ab45-431bfcb60992'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '0bf7f900-74fb-4dea-a83f-7b2b8549ccf1', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk 1073741824" returned: 0 in 0.765s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.120s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:27 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1f95d63abd36b28c211d50cea3a8917c',container_format='bare',created_at=2023-07-26T17:00:17Z,direct_url=<?>,disk_format='qcow2',id=f5276db9-43a1-4fd5-a06b-bec113e04585,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-932025414-shelved',owner='f389f41a191747e68ceeb776fdcbff40',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-26T17:00:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbXNqrKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:27 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:27 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:27 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390932.5449824, 2c9162fc-40f6-462c-843a-fa279515db41 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:27 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] VM Stopped (Lifecycle Event)
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c37cd9-1720-4ad1-9012-57147dc3113a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:02:27 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.472s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2a9864-f016-466b-b0cf-62469ee86622]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992] added
Jul 26 17:02:27 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9391914b-99b2-4f99-9caa-a4b19ce8c8de None None] [instance: 2c9162fc-40f6-462c-843a-fa279515db41] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb2d9ef-c664-4c54-8ed0-ce9db9febef6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9a985-565e-402e-82cd-fd025801d78a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbXNqrKa {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbXNqrKa" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bba8b0-973b-4168-8033-cbd37a430ab3]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbXNqrKa'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Cannot resize image /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'migration_context' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[135241c0-2f97-46e4-aed2-64420ae23df8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6793d04-ae8e-4b41-b144-aed6cdef8d0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:27 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:27 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:27 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd5518-1d62-4613-801a-5fee3dd1bd2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260]
Jul 26 17:02:28 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260] successful.
Jul 26 17:02:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2c4ce-fa6c-45e4-a9f5-4e956b6c6a53]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdb2c21-6bfc-42e6-9f3c-e7ca19c90d63]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:28 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:02:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:28 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:02:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8652198-04da-48f3-b7d8-4bca58aa3127]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbXNqrKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Successfully created port: 63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] <== connect_volume: return (1536ms) {'type': 'block', 'scsi_wwn': '26539383135653761', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539383135653761', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-932025414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-932025414',id=7,image_ref='f5276db9-43a1-4fd5-a06b-bec113e04585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1077150454',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-2sdwm5fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member',shelved_at='2023-07-26T17:00:22.738638',shelved_host='user',shelved_image_id='f5276db9-43a1-4fd5-a06b-bec113e04585'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=ae56085e-6a66-494f-9ec0-2397ec7eb4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'pci_devices' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:29 user nova-compute[70594]:   <uuid>ae56085e-6a66-494f-9ec0-2397ec7eb4b0</uuid>
Jul 26 17:02:29 user nova-compute[70594]:   <name>instance-00000007</name>
Jul 26 17:02:29 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:02:29 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:29 user nova-compute[70594]:   <metadata>
Jul 26 17:02:29 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:29 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:29 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-932025414</nova:name>
Jul 26 17:02:29 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:27</nova:creationTime>
Jul 26 17:02:29 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:02:29 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:29 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:29 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:user uuid="e9714a3b9e9d44f6b22c49d3d495d7ad">tempest-AttachVolumeShelveTestJSON-1781489687-project-member</nova:user>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:project uuid="f389f41a191747e68ceeb776fdcbff40">tempest-AttachVolumeShelveTestJSON-1781489687</nova:project>
Jul 26 17:02:29 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:29 user nova-compute[70594]:       <nova:root type="image" uuid="f5276db9-43a1-4fd5-a06b-bec113e04585"/>
Jul 26 17:02:29 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:29 user nova-compute[70594]:         <nova:port uuid="58242289-8f80-4512-8cdb-0847afd81d42">
Jul 26 17:02:29 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 26 17:02:29 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:29 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:29 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:29 user nova-compute[70594]:   </metadata>
Jul 26 17:02:29 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:29 user nova-compute[70594]:     <system>
Jul 26 17:02:29 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:29 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:29 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:29 user nova-compute[70594]:       <entry name="serial">ae56085e-6a66-494f-9ec0-2397ec7eb4b0</entry>
Jul 26 17:02:29 user nova-compute[70594]:       <entry name="uuid">ae56085e-6a66-494f-9ec0-2397ec7eb4b0</entry>
Jul 26 17:02:29 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:29 user nova-compute[70594]:     </system>
Jul 26 17:02:29 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:29 user nova-compute[70594]:   <os>
Jul 26 17:02:29 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:29 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:02:29 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:29 user nova-compute[70594]:   </os>
Jul 26 17:02:29 user nova-compute[70594]:   <features>
Jul 26 17:02:29 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:29 user nova-compute[70594]:     <apic/>
Jul 26 17:02:29 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:29 user nova-compute[70594]:   </features>
Jul 26 17:02:29 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:29 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:29 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:29 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:29 user nova-compute[70594]:   </clock>
Jul 26 17:02:29 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:29 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:29 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:29 user nova-compute[70594]:   </cpu>
Jul 26 17:02:29 user nova-compute[70594]:   <devices>
Jul 26 17:02:29 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:29 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:29 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk"/>
Jul 26 17:02:29 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:29 user nova-compute[70594]:     </disk>
Jul 26 17:02:29 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:02:29 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:02:29 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 17:02:29 user nova-compute[70594]:       <target dev="vdc" bus="virtio"/>
Jul 26 17:02:29 user nova-compute[70594]:       <serial>166a5665-5d42-4e94-ab45-431bfcb60992</serial>
Jul 26 17:02:29 user nova-compute[70594]:     </disk>
Jul 26 17:02:29 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:29 user nova-compute[70594]:       <mac address="fa:16:3e:f0:9b:cd"/>
Jul 26 17:02:29 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:29 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:29 user nova-compute[70594]:       <target dev="tap58242289-8f"/>
Jul 26 17:02:29 user nova-compute[70594]:     </interface>
Jul 26 17:02:29 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:29 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/console.log" append="off"/>
Jul 26 17:02:29 user nova-compute[70594]:     </serial>
Jul 26 17:02:29 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:29 user nova-compute[70594]:     <video>
Jul 26 17:02:29 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:29 user nova-compute[70594]:     </video>
Jul 26 17:02:29 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:29 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:29 user nova-compute[70594]:     </rng>
Jul 26 17:02:29 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:29 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:29 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:29 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:29 user nova-compute[70594]:   </devices>
Jul 26 17:02:29 user nova-compute[70594]: </domain>
Jul 26 17:02:29 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-932025414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-932025414',id=7,image_ref='f5276db9-43a1-4fd5-a06b-bec113e04585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1077150454',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-2sdwm5fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member',shelved_at='2023-07-26T17:00:22.738638',shelved_host='user',shelved_image_id='f5276db9-43a1-4fd5-a06b-bec113e04585'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=ae56085e-6a66-494f-9ec0-2397ec7eb4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG os_vif [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58242289-8f, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58242289-8f, col_values=(('external_ids', {'iface-id': '58242289-8f80-4512-8cdb-0847afd81d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:9b:cd', 'vm-uuid': 'ae56085e-6a66-494f-9ec0-2397ec7eb4b0'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:29 user nova-compute[70594]: INFO os_vif [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f')
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No VIF found with MAC fa:16:3e:f0:9b:cd, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Successfully updated port: 63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquired lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-changed-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Refreshing instance network info cache due to event network-changed-63fbb581-4956-4207-be9e-689d6b22104d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] Acquiring lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Releasing lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Instance network_info: |[{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] Acquired lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Refreshing network info cache for port 63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Start _get_guest_xml network_info=[{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:30 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:30 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:30 user nova-compute[70594]:   <uuid>f2b78e55-2422-4aa4-9cc7-cec7a964d901</uuid>
Jul 26 17:02:30 user nova-compute[70594]:   <name>instance-00000012</name>
Jul 26 17:02:30 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:02:30 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:30 user nova-compute[70594]:   <metadata>
Jul 26 17:02:30 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:30 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:30 user nova-compute[70594]:       <nova:name>tempest-device-tagging-server-1535981382</nova:name>
Jul 26 17:02:30 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:30</nova:creationTime>
Jul 26 17:02:30 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:02:30 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:30 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:30 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:user uuid="472502ad99de4e669f2adb09afefe2d4">tempest-TaggedAttachmentsTest-15597414-project-member</nova:user>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:project uuid="ae4c76df80df42b0b4744e11d2f61b04">tempest-TaggedAttachmentsTest-15597414</nova:project>
Jul 26 17:02:30 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:30 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:02:30 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:30 user nova-compute[70594]:         <nova:port uuid="63fbb581-4956-4207-be9e-689d6b22104d">
Jul 26 17:02:30 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:02:30 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:30 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:30 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:30 user nova-compute[70594]:   </metadata>
Jul 26 17:02:30 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:30 user nova-compute[70594]:     <system>
Jul 26 17:02:30 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:30 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:30 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:30 user nova-compute[70594]:       <entry name="serial">f2b78e55-2422-4aa4-9cc7-cec7a964d901</entry>
Jul 26 17:02:30 user nova-compute[70594]:       <entry name="uuid">f2b78e55-2422-4aa4-9cc7-cec7a964d901</entry>
Jul 26 17:02:30 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:30 user nova-compute[70594]:     </system>
Jul 26 17:02:30 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:30 user nova-compute[70594]:   <os>
Jul 26 17:02:30 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:30 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:02:30 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:30 user nova-compute[70594]:   </os>
Jul 26 17:02:30 user nova-compute[70594]:   <features>
Jul 26 17:02:30 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:30 user nova-compute[70594]:     <apic/>
Jul 26 17:02:30 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:30 user nova-compute[70594]:   </features>
Jul 26 17:02:30 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:30 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:30 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:30 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:30 user nova-compute[70594]:   </clock>
Jul 26 17:02:30 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:30 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:30 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:30 user nova-compute[70594]:   </cpu>
Jul 26 17:02:30 user nova-compute[70594]:   <devices>
Jul 26 17:02:30 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:30 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:30 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk"/>
Jul 26 17:02:30 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:30 user nova-compute[70594]:     </disk>
Jul 26 17:02:30 user nova-compute[70594]:     <disk type="file" device="cdrom">
Jul 26 17:02:30 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none"/>
Jul 26 17:02:30 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.config"/>
Jul 26 17:02:30 user nova-compute[70594]:       <target dev="hda" bus="ide"/>
Jul 26 17:02:30 user nova-compute[70594]:     </disk>
Jul 26 17:02:30 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:30 user nova-compute[70594]:       <mac address="fa:16:3e:85:13:20"/>
Jul 26 17:02:30 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:30 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:30 user nova-compute[70594]:       <target dev="tap63fbb581-49"/>
Jul 26 17:02:30 user nova-compute[70594]:     </interface>
Jul 26 17:02:30 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:30 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/console.log" append="off"/>
Jul 26 17:02:30 user nova-compute[70594]:     </serial>
Jul 26 17:02:30 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:30 user nova-compute[70594]:     <video>
Jul 26 17:02:30 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:30 user nova-compute[70594]:     </video>
Jul 26 17:02:30 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:30 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:30 user nova-compute[70594]:     </rng>
Jul 26 17:02:30 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:30 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:30 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:30 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:30 user nova-compute[70594]:   </devices>
Jul 26 17:02:30 user nova-compute[70594]: </domain>
Jul 26 17:02:30 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG os_vif [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63fbb581-49, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63fbb581-49, col_values=(('external_ids', {'iface-id': '63fbb581-4956-4207-be9e-689d6b22104d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:13:20', 'vm-uuid': 'f2b78e55-2422-4aa4-9cc7-cec7a964d901'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:30 user nova-compute[70594]: INFO os_vif [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49')
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No BDM found with device name hda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No VIF found with MAC fa:16:3e:85:13:20, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:30 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Using config drive
Jul 26 17:02:30 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Creating config drive at /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.config
Jul 26 17:02:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn04kvumm {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn04kvumm" returned: 0 in 0.069s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updated VIF entry in instance network info cache for port 63fbb581-4956-4207-be9e-689d6b22104d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG nova.network.neutron [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdf8c82e-1cf0-4616-8966-69bd5ffc73de req-b7b51d12-c43a-4fe1-8b52-5e798f1c4933 service nova] Releasing lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-cfd3eaaf-9b9e-438d-ac63-308e011d5702 req-c431cc13-d020-4347-9db4-04f282797759 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cfd3eaaf-9b9e-438d-ac63-308e011d5702 req-c431cc13-d020-4347-9db4-04f282797759 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cfd3eaaf-9b9e-438d-ac63-308e011d5702 req-c431cc13-d020-4347-9db4-04f282797759 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cfd3eaaf-9b9e-438d-ac63-308e011d5702 req-c431cc13-d020-4347-9db4-04f282797759 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-cfd3eaaf-9b9e-438d-ac63-308e011d5702 req-c431cc13-d020-4347-9db4-04f282797759 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:31 user nova-compute[70594]: WARNING nova.compute.manager [req-cfd3eaaf-9b9e-438d-ac63-308e011d5702 req-c431cc13-d020-4347-9db4-04f282797759 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Starting finish_migration {{(pid=70594) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:02:32 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Creating image(s)
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'trusted_certs' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk. size=21474836480 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk 21474836480 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk 21474836480" returned: 0 in 0.055s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Ensure instance console log exists: /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start _get_guest_xml network_info=[{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a624beaa-5c38-4aee-9c04-4e888e85f0f9', 'attached_at': '2023-07-26T17:02:32.000000', 'detached_at': '', 'volume_id': 'aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'serial': 'aa9af32a-f17c-4993-b3b2-9b1e89a6aac9'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '6446d36a-c999-4e2f-8c19-bb1889c504d7', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:32 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:32 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'vcpu_model' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:02:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:02:32 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[418155e6-0349-45ae-a2ea-64b2e7eaced7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:02:32 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30777879-94d8-4d58-8e27-bd8a1b6e2e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9] added
Jul 26 17:02:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b059dd-797e-4c07-abcf-19c242f78ac4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba40a4-3f88-42e6-86b7-d2f24214fb1c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdcHDxBP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdcHDxBP" returned: 0 in 0.047s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f3635-08ad-4a37-b4d1-3a44073e3d89]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdcHDxBP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83953000-5f98-458b-ad63-2f48ad2c1466]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.078s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5baec-c7cb-479f-96de-cd3c5f0af08b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[162e73de-ed7a-41aa-bd76-215fd30bcb14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]
Jul 26 17:02:33 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.
Jul 26 17:02:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690390938.2773345, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:33 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Stopped (Lifecycle Event)
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[468bc61a-f84a-4166-841f-88dff6303c7f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18dc41c-73fd-471b-9507-eea3e1a951b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:02:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.522s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e231f808-2701-4422-88d0-8a9b95192685 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e231f808-2701-4422-88d0-8a9b95192685 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6aad59-4d70-48fd-ad63-c87d5d253317]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:02:33 user nova-compute[70594]: INFO nova.compute.manager [None req-e231f808-2701-4422-88d0-8a9b95192685 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-60939008-b3ef-426f-9b75-236b949ca08f req-000c17f6-c46b-4873-a2c0-549e97459981 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-60939008-b3ef-426f-9b75-236b949ca08f req-000c17f6-c46b-4873-a2c0-549e97459981 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-60939008-b3ef-426f-9b75-236b949ca08f req-000c17f6-c46b-4873-a2c0-549e97459981 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-60939008-b3ef-426f-9b75-236b949ca08f req-000c17f6-c46b-4873-a2c0-549e97459981 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-60939008-b3ef-426f-9b75-236b949ca08f req-000c17f6-c46b-4873-a2c0-549e97459981 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:33 user nova-compute[70594]: WARNING nova.compute.manager [req-60939008-b3ef-426f-9b75-236b949ca08f req-000c17f6-c46b-4873-a2c0-549e97459981 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c48920c-94ee-4bb1-b622-e806cc1f6a19 req-176153a1-d1ae-4420-8a57-34c0008ce161 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c48920c-94ee-4bb1-b622-e806cc1f6a19 req-176153a1-d1ae-4420-8a57-34c0008ce161 service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c48920c-94ee-4bb1-b622-e806cc1f6a19 req-176153a1-d1ae-4420-8a57-34c0008ce161 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c48920c-94ee-4bb1-b622-e806cc1f6a19 req-176153a1-d1ae-4420-8a57-34c0008ce161 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c48920c-94ee-4bb1-b622-e806cc1f6a19 req-176153a1-d1ae-4420-8a57-34c0008ce161 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:33 user nova-compute[70594]: WARNING nova.compute.manager [req-3c48920c-94ee-4bb1-b622-e806cc1f6a19 req-176153a1-d1ae-4420-8a57-34c0008ce161 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d for instance with vm_state building and task_state spawning.
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.566s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== connect_volume: return (1568ms) {'type': 'block', 'scsi_wwn': '23530626331663662', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530626331663662', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:34 user nova-compute[70594]:   <uuid>a624beaa-5c38-4aee-9c04-4e888e85f0f9</uuid>
Jul 26 17:02:34 user nova-compute[70594]:   <name>instance-00000006</name>
Jul 26 17:02:34 user nova-compute[70594]:   <memory>2097152</memory>
Jul 26 17:02:34 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:34 user nova-compute[70594]:   <metadata>
Jul 26 17:02:34 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:34 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:34 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherB-server-478314950</nova:name>
Jul 26 17:02:34 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:32</nova:creationTime>
Jul 26 17:02:34 user nova-compute[70594]:       <nova:flavor name="m1.small">
Jul 26 17:02:34 user nova-compute[70594]:         <nova:memory>2048</nova:memory>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:disk>20</nova:disk>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:34 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:34 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:user uuid="43c125b2ba334237878f2c655fed828a">tempest-ServerActionsTestOtherB-1823585199-project-member</nova:user>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:project uuid="4fbd171f41764f60b8abe257e5f6e2c2">tempest-ServerActionsTestOtherB-1823585199</nova:project>
Jul 26 17:02:34 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:34 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:02:34 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:34 user nova-compute[70594]:         <nova:port uuid="87faecb4-e13b-455f-911b-2c9f9e614336">
Jul 26 17:02:34 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:02:34 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:34 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:34 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:34 user nova-compute[70594]:   </metadata>
Jul 26 17:02:34 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:34 user nova-compute[70594]:     <system>
Jul 26 17:02:34 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:34 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:34 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:34 user nova-compute[70594]:       <entry name="serial">a624beaa-5c38-4aee-9c04-4e888e85f0f9</entry>
Jul 26 17:02:34 user nova-compute[70594]:       <entry name="uuid">a624beaa-5c38-4aee-9c04-4e888e85f0f9</entry>
Jul 26 17:02:34 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:34 user nova-compute[70594]:     </system>
Jul 26 17:02:34 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:34 user nova-compute[70594]:   <os>
Jul 26 17:02:34 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:34 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:02:34 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:34 user nova-compute[70594]:   </os>
Jul 26 17:02:34 user nova-compute[70594]:   <features>
Jul 26 17:02:34 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:34 user nova-compute[70594]:     <apic/>
Jul 26 17:02:34 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:34 user nova-compute[70594]:   </features>
Jul 26 17:02:34 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:34 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:34 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:34 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:34 user nova-compute[70594]:   </clock>
Jul 26 17:02:34 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:34 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:34 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:34 user nova-compute[70594]:   </cpu>
Jul 26 17:02:34 user nova-compute[70594]:   <devices>
Jul 26 17:02:34 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:34 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:34 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk"/>
Jul 26 17:02:34 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:34 user nova-compute[70594]:     </disk>
Jul 26 17:02:34 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:02:34 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:02:34 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:02:34 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:02:34 user nova-compute[70594]:       <serial>aa9af32a-f17c-4993-b3b2-9b1e89a6aac9</serial>
Jul 26 17:02:34 user nova-compute[70594]:     </disk>
Jul 26 17:02:34 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:34 user nova-compute[70594]:       <mac address="fa:16:3e:be:a5:cb"/>
Jul 26 17:02:34 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:34 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:34 user nova-compute[70594]:       <target dev="tap87faecb4-e1"/>
Jul 26 17:02:34 user nova-compute[70594]:     </interface>
Jul 26 17:02:34 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:34 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/console.log" append="off"/>
Jul 26 17:02:34 user nova-compute[70594]:     </serial>
Jul 26 17:02:34 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:34 user nova-compute[70594]:     <video>
Jul 26 17:02:34 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:34 user nova-compute[70594]:     </video>
Jul 26 17:02:34 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:34 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:34 user nova-compute[70594]:     </rng>
Jul 26 17:02:34 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:34 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:34 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:34 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:34 user nova-compute[70594]:   </devices>
Jul 26 17:02:34 user nova-compute[70594]: </domain>
Jul 26 17:02:34 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-101219853-network", "vif_mac": "fa:16:3e:be:a5:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG os_vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87faecb4-e1, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87faecb4-e1, col_values=(('external_ids', {'iface-id': '87faecb4-e13b-455f-911b-2c9f9e614336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:a5:cb', 'vm-uuid': 'a624beaa-5c38-4aee-9c04-4e888e85f0f9'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:34 user nova-compute[70594]: INFO os_vif [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1')
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] No VIF found with MAC fa:16:3e:be:a5:cb, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390955.5408678, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] VM Resumed (Lifecycle Event)
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance spawned successfully.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390955.5447044, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] VM Started (Lifecycle Event)
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Instance spawned successfully.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-37d61d25-7b1f-4187-b19d-635ce32480e8 req-4625a639-6c29-46e5-977a-554c67585ee1 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-37d61d25-7b1f-4187-b19d-635ce32480e8 req-4625a639-6c29-46e5-977a-554c67585ee1 service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-37d61d25-7b1f-4187-b19d-635ce32480e8 req-4625a639-6c29-46e5-977a-554c67585ee1 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-37d61d25-7b1f-4187-b19d-635ce32480e8 req-4625a639-6c29-46e5-977a-554c67585ee1 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-37d61d25-7b1f-4187-b19d-635ce32480e8 req-4625a639-6c29-46e5-977a-554c67585ee1 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:35 user nova-compute[70594]: WARNING nova.compute.manager [req-37d61d25-7b1f-4187-b19d-635ce32480e8 req-4625a639-6c29-46e5-977a-554c67585ee1 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d for instance with vm_state building and task_state spawning.
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390955.6467252, f2b78e55-2422-4aa4-9cc7-cec7a964d901 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] VM Resumed (Lifecycle Event)
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390955.65676, f2b78e55-2422-4aa4-9cc7-cec7a964d901 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] VM Started (Lifecycle Event)
Jul 26 17:02:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Took 10.01 seconds to spawn the instance on the hypervisor.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:35 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:02:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7ee12fb5-9a5e-4c08-ab21-adde67aadfbb tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.433s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:36 user nova-compute[70594]: INFO nova.compute.manager [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Took 11.24 seconds to build instance.
Jul 26 17:02:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c0f78bd5-ec8c-41ca-9304-af476444b11d tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.392s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-b37f752c-79b5-4b2e-a640-ff55b8afa2d2 req-245d11c0-9c69-4510-8957-346830c9aa25 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b37f752c-79b5-4b2e-a640-ff55b8afa2d2 req-245d11c0-9c69-4510-8957-346830c9aa25 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b37f752c-79b5-4b2e-a640-ff55b8afa2d2 req-245d11c0-9c69-4510-8957-346830c9aa25 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b37f752c-79b5-4b2e-a640-ff55b8afa2d2 req-245d11c0-9c69-4510-8957-346830c9aa25 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-b37f752c-79b5-4b2e-a640-ff55b8afa2d2 req-245d11c0-9c69-4510-8957-346830c9aa25 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:36 user nova-compute[70594]: WARNING nova.compute.manager [req-b37f752c-79b5-4b2e-a640-ff55b8afa2d2 req-245d11c0-9c69-4510-8957-346830c9aa25 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state active and task_state resize_finish.
Jul 26 17:02:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4561822-0d80-42cc-9f5d-270a9e614817 req-53c2e5a6-50c3-4830-b1f4-90b2c098b81d service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4561822-0d80-42cc-9f5d-270a9e614817 req-53c2e5a6-50c3-4830-b1f4-90b2c098b81d service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4561822-0d80-42cc-9f5d-270a9e614817 req-53c2e5a6-50c3-4830-b1f4-90b2c098b81d service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d4561822-0d80-42cc-9f5d-270a9e614817 req-53c2e5a6-50c3-4830-b1f4-90b2c098b81d service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-d4561822-0d80-42cc-9f5d-270a9e614817 req-53c2e5a6-50c3-4830-b1f4-90b2c098b81d service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:38 user nova-compute[70594]: WARNING nova.compute.manager [req-d4561822-0d80-42cc-9f5d-270a9e614817 req-53c2e5a6-50c3-4830-b1f4-90b2c098b81d service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state active and task_state resize_finish.
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390958.6867778, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:38 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Resumed (Lifecycle Event)
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:02:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance running successfully.
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Failed to set time: agent not configured {{(pid=70594) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e9e2148e-4fd0-4191-b883-3a569c337483 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] finish_migration finished successfully. {{(pid=70594) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:38 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390958.6904285, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:02:38 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Started (Lifecycle Event)
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:02:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:02:38 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 26 17:02:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:54 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:02:54 user nova-compute[70594]: INFO nova.compute.claims [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Claim successful on node user
Jul 26 17:02:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:02:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.policy [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f042f51e92ac400ea26bce166a410123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75af562500b4c6a8586de2079994e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:02:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Creating image(s)
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "/opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "/opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "/opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.181s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:56 user nova-compute[70594]: INFO nova.compute.manager [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Rescuing
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk 1073741824" returned: 0 in 0.061s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Cannot resize image /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.objects.instance [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'migration_context' on Instance uuid 60c4b302-f745-4b4c-8462-258338fcb0fe {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Ensure instance console log exists: /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Successfully created port: 402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-bdc7e0ee-4eb8-4755-8340-39609b8c550a req-348a99fd-6711-417d-bebb-f8405ad50898 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdc7e0ee-4eb8-4755-8340-39609b8c550a req-348a99fd-6711-417d-bebb-f8405ad50898 service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdc7e0ee-4eb8-4755-8340-39609b8c550a req-348a99fd-6711-417d-bebb-f8405ad50898 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdc7e0ee-4eb8-4755-8340-39609b8c550a req-348a99fd-6711-417d-bebb-f8405ad50898 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-bdc7e0ee-4eb8-4755-8340-39609b8c550a req-348a99fd-6711-417d-bebb-f8405ad50898 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:57 user nova-compute[70594]: WARNING nova.compute.manager [req-bdc7e0ee-4eb8-4755-8340-39609b8c550a req-348a99fd-6711-417d-bebb-f8405ad50898 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state active and task_state rescuing.
Jul 26 17:02:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance destroyed successfully.
Jul 26 17:02:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Attempting rescue
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70594) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:02:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Creating image(s)
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'trusted_certs' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue" returned: 0 in 0.056s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'migration_context' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Start _get_guest_xml network_info=[{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:18:95:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'resources' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'numa_topology' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Successfully updated port: 402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:02:58 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:58 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.objects.instance [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'vcpu_model' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquired lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135380042',display_name='tempest-ServerRescueNegativeTestJSON-server-135380042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135380042',id=3,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-el3f5453',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T16:58:23Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=026577e6-2de3-45b9-adbf-7686e72a8c61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:18:95:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:18:95:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.objects.instance [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'pci_devices' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-changed-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Refreshing instance network info cache due to event network-changed-402aafc0-cc42-483f-8bea-81d9184e537e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] Acquiring lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:58 user nova-compute[70594]:   <uuid>026577e6-2de3-45b9-adbf-7686e72a8c61</uuid>
Jul 26 17:02:58 user nova-compute[70594]:   <name>instance-00000003</name>
Jul 26 17:02:58 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:02:58 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:58 user nova-compute[70594]:   <metadata>
Jul 26 17:02:58 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:58 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-135380042</nova:name>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:58</nova:creationTime>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:02:58 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:58 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:user uuid="f5f5bd39056d4ebc973b6d8571a796ab">tempest-ServerRescueNegativeTestJSON-159727237-project-member</nova:user>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:project uuid="a2349e37642f4f4d9a3fe7b2c3d7a6c7">tempest-ServerRescueNegativeTestJSON-159727237</nova:project>
Jul 26 17:02:58 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:port uuid="7ba2b845-fb6d-491b-943c-f6c7470ef865">
Jul 26 17:02:58 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 26 17:02:58 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:58 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:58 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:58 user nova-compute[70594]:   </metadata>
Jul 26 17:02:58 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:58 user nova-compute[70594]:     <system>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="serial">026577e6-2de3-45b9-adbf-7686e72a8c61</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="uuid">026577e6-2de3-45b9-adbf-7686e72a8c61</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:58 user nova-compute[70594]:     </system>
Jul 26 17:02:58 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:58 user nova-compute[70594]:   <os>
Jul 26 17:02:58 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:58 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:58 user nova-compute[70594]:   </os>
Jul 26 17:02:58 user nova-compute[70594]:   <features>
Jul 26 17:02:58 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:58 user nova-compute[70594]:     <apic/>
Jul 26 17:02:58 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:58 user nova-compute[70594]:   </features>
Jul 26 17:02:58 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:58 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:58 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:58 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:58 user nova-compute[70594]:   </clock>
Jul 26 17:02:58 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:58 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:58 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:58 user nova-compute[70594]:   </cpu>
Jul 26 17:02:58 user nova-compute[70594]:   <devices>
Jul 26 17:02:58 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:58 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:58 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue"/>
Jul 26 17:02:58 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:     </disk>
Jul 26 17:02:58 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:58 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:58 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk"/>
Jul 26 17:02:58 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:     </disk>
Jul 26 17:02:58 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:58 user nova-compute[70594]:       <mac address="fa:16:3e:18:95:5f"/>
Jul 26 17:02:58 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:58 user nova-compute[70594]:       <target dev="tap7ba2b845-fb"/>
Jul 26 17:02:58 user nova-compute[70594]:     </interface>
Jul 26 17:02:58 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:58 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/console.log" append="off"/>
Jul 26 17:02:58 user nova-compute[70594]:     </serial>
Jul 26 17:02:58 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:58 user nova-compute[70594]:     <video>
Jul 26 17:02:58 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:     </video>
Jul 26 17:02:58 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:58 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:58 user nova-compute[70594]:     </rng>
Jul 26 17:02:58 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:58 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:58 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:58 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:58 user nova-compute[70594]:   </devices>
Jul 26 17:02:58 user nova-compute[70594]: </domain>
Jul 26 17:02:58 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance destroyed successfully.
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:18:95:5f, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Updating instance_info_cache with network_info: [{"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Releasing lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Instance network_info: |[{"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] Acquired lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Refreshing network info cache for port 402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Start _get_guest_xml network_info=[{"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:02:58 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:58 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1135721985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1135721985',id=19,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+tJo+xie//py0ysaODxNFuqBpFph4h3PGRHlWFPlZoGuXnMh4n5oxv0LGSWUqnbqDE1Lm5dM9OyWq7IuLRwxw9QaPGe7NCJtl5fXWDqAq3Xr4fGcFJnuGA+2jcHHNC2Q==',key_name='tempest-keypair-783037101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-wniyzd29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=60c4b302-f745-4b4c-8462-258338fcb0fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.objects.instance [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'pci_devices' on Instance uuid 60c4b302-f745-4b4c-8462-258338fcb0fe {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:02:58 user nova-compute[70594]:   <uuid>60c4b302-f745-4b4c-8462-258338fcb0fe</uuid>
Jul 26 17:02:58 user nova-compute[70594]:   <name>instance-00000013</name>
Jul 26 17:02:58 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:02:58 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:02:58 user nova-compute[70594]:   <metadata>
Jul 26 17:02:58 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:02:58 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1135721985</nova:name>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:02:58</nova:creationTime>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:02:58 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:02:58 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:owner>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:user uuid="f042f51e92ac400ea26bce166a410123">tempest-ServerActionsV293TestJSON-607585814-project-member</nova:user>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:project uuid="c75af562500b4c6a8586de2079994e90">tempest-ServerActionsV293TestJSON-607585814</nova:project>
Jul 26 17:02:58 user nova-compute[70594]:       </nova:owner>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:02:58 user nova-compute[70594]:       <nova:ports>
Jul 26 17:02:58 user nova-compute[70594]:         <nova:port uuid="402aafc0-cc42-483f-8bea-81d9184e537e">
Jul 26 17:02:58 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 26 17:02:58 user nova-compute[70594]:         </nova:port>
Jul 26 17:02:58 user nova-compute[70594]:       </nova:ports>
Jul 26 17:02:58 user nova-compute[70594]:     </nova:instance>
Jul 26 17:02:58 user nova-compute[70594]:   </metadata>
Jul 26 17:02:58 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:02:58 user nova-compute[70594]:     <system>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="serial">60c4b302-f745-4b4c-8462-258338fcb0fe</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="uuid">60c4b302-f745-4b4c-8462-258338fcb0fe</entry>
Jul 26 17:02:58 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:02:58 user nova-compute[70594]:     </system>
Jul 26 17:02:58 user nova-compute[70594]:   </sysinfo>
Jul 26 17:02:58 user nova-compute[70594]:   <os>
Jul 26 17:02:58 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:02:58 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:02:58 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:02:58 user nova-compute[70594]:   </os>
Jul 26 17:02:58 user nova-compute[70594]:   <features>
Jul 26 17:02:58 user nova-compute[70594]:     <acpi/>
Jul 26 17:02:58 user nova-compute[70594]:     <apic/>
Jul 26 17:02:58 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:02:58 user nova-compute[70594]:   </features>
Jul 26 17:02:58 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:02:58 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:02:58 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:02:58 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:02:58 user nova-compute[70594]:   </clock>
Jul 26 17:02:58 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:02:58 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:02:58 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:02:58 user nova-compute[70594]:   </cpu>
Jul 26 17:02:58 user nova-compute[70594]:   <devices>
Jul 26 17:02:58 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:02:58 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:02:58 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk"/>
Jul 26 17:02:58 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:     </disk>
Jul 26 17:02:58 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:02:58 user nova-compute[70594]:       <mac address="fa:16:3e:d9:06:f5"/>
Jul 26 17:02:58 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:02:58 user nova-compute[70594]:       <target dev="tap402aafc0-cc"/>
Jul 26 17:02:58 user nova-compute[70594]:     </interface>
Jul 26 17:02:58 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:02:58 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/console.log" append="off"/>
Jul 26 17:02:58 user nova-compute[70594]:     </serial>
Jul 26 17:02:58 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:02:58 user nova-compute[70594]:     <video>
Jul 26 17:02:58 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:02:58 user nova-compute[70594]:     </video>
Jul 26 17:02:58 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:02:58 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:02:58 user nova-compute[70594]:     </rng>
Jul 26 17:02:58 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:02:58 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:02:58 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:02:58 user nova-compute[70594]:     </memballoon>
Jul 26 17:02:58 user nova-compute[70594]:   </devices>
Jul 26 17:02:58 user nova-compute[70594]: </domain>
Jul 26 17:02:58 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1135721985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1135721985',id=19,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+tJo+xie//py0ysaODxNFuqBpFph4h3PGRHlWFPlZoGuXnMh4n5oxv0LGSWUqnbqDE1Lm5dM9OyWq7IuLRwxw9QaPGe7NCJtl5fXWDqAq3Xr4fGcFJnuGA+2jcHHNC2Q==',key_name='tempest-keypair-783037101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-wniyzd29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=60c4b302-f745-4b4c-8462-258338fcb0fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG os_vif [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap402aafc0-cc, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap402aafc0-cc, col_values=(('external_ids', {'iface-id': '402aafc0-cc42-483f-8bea-81d9184e537e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:06:f5', 'vm-uuid': '60c4b302-f745-4b4c-8462-258338fcb0fe'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:02:58 user nova-compute[70594]: INFO os_vif [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc')
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:02:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] No VIF found with MAC fa:16:3e:d9:06:f5, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG nova.network.neutron [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Updated VIF entry in instance network info cache for port 402aafc0-cc42-483f-8bea-81d9184e537e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG nova.network.neutron [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Updating instance_info_cache with network_info: [{"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-59510f1e-b07f-4be1-858c-74244f5da571 req-0f95840b-aa54-4da2-962e-e1c069815cd5 service nova] Releasing lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-9fcbf685-ebc4-4eb4-b8b6-bfcfcbf69818 req-104c3a9b-9002-4fae-bfd7-c4b0ce250754 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9fcbf685-ebc4-4eb4-b8b6-bfcfcbf69818 req-104c3a9b-9002-4fae-bfd7-c4b0ce250754 service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9fcbf685-ebc4-4eb4-b8b6-bfcfcbf69818 req-104c3a9b-9002-4fae-bfd7-c4b0ce250754 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9fcbf685-ebc4-4eb4-b8b6-bfcfcbf69818 req-104c3a9b-9002-4fae-bfd7-c4b0ce250754 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-9fcbf685-ebc4-4eb4-b8b6-bfcfcbf69818 req-104c3a9b-9002-4fae-bfd7-c4b0ce250754 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:02:59 user nova-compute[70594]: WARNING nova.compute.manager [req-9fcbf685-ebc4-4eb4-b8b6-bfcfcbf69818 req-104c3a9b-9002-4fae-bfd7-c4b0ce250754 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state active and task_state rescuing.
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:02:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:03:01 user nova-compute[70594]: WARNING nova.compute.manager [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state active and task_state rescuing.
Jul 26 17:03:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:03:01 user nova-compute[70594]: WARNING nova.compute.manager [req-ec66a7fb-38d3-4aa7-8ec8-40dc1f73918e req-3a033861-a495-4dd9-b594-e3c568bfa89f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state active and task_state rescuing.
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 026577e6-2de3-45b9-adbf-7686e72a8c61 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390984.0551238, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:03:04 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Resumed (Lifecycle Event)
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] No waiting events found dispatching network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:03:04 user nova-compute[70594]: WARNING nova.compute.manager [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received unexpected event network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e for instance with vm_state building and task_state spawning.
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] No waiting events found dispatching network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:03:04 user nova-compute[70594]: WARNING nova.compute.manager [req-513175df-33d6-416c-947b-14897ac0dc65 req-7190309c-b274-429f-8459-4359ad98c47d service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received unexpected event network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e for instance with vm_state building and task_state spawning.
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-54c9903d-2762-4971-9c00-7617d7ce777e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:03:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7079MB free_disk=25.36715316772461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:04 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Instance spawned successfully.
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:03:04 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:03:04 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390984.0575254, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:03:04 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Started (Lifecycle Event)
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:05 user nova-compute[70594]: INFO nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Took 9.49 seconds to spawn the instance on the hypervisor.
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Applying migration context for instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 as it has an incoming, in-progress migration 6693ef55-1704-409b-875a-29c0b64b6407. Migration status is finished {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:987}}
Jul 26 17:03:05 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating resource usage from migration 6693ef55-1704-409b-875a-29c0b64b6407
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390984.1626794, 60c4b302-f745-4b4c-8462-258338fcb0fe => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:03:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] VM Resumed (Lifecycle Event)
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance dcfcdd0b-bff7-40d0-b924-daffc40e43e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 76a02a97-4400-44d2-8655-89fc12f69682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Migration 6693ef55-1704-409b-875a-29c0b64b6407 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1674}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:03:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690390984.1633995, 60c4b302-f745-4b4c-8462-258338fcb0fe => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:03:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] VM Started (Lifecycle Event)
Jul 26 17:03:05 user nova-compute[70594]: INFO nova.compute.manager [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Took 10.49 seconds to build instance.
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-50f0247d-ca32-483f-8ffa-0180f5911a33 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.616s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:03:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.113s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:06 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:03:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:03:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:03:07 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:03:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:18 user nova-compute[70594]: INFO nova.compute.manager [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] instance snapshotting
Jul 26 17:03:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Beginning live snapshot process
Jul 26 17:03:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpslgli7bj/958c35a12ca4487bad2086347040a89e.delta 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpslgli7bj/958c35a12ca4487bad2086347040a89e.delta 1073741824" returned: 0 in 0.052s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 26 17:03:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:03:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] COPY block job progress, current cursor: 13303808 final cursor: 75497472 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:03:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] COPY block job progress, current cursor: 75038720 final cursor: 75497472 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:03:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:03:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 26 17:03:21 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:03:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpslgli7bj/958c35a12ca4487bad2086347040a89e.delta /opt/stack/data/nova/instances/snapshots/tmpslgli7bj/958c35a12ca4487bad2086347040a89e {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpslgli7bj/958c35a12ca4487bad2086347040a89e.delta /opt/stack/data/nova/instances/snapshots/tmpslgli7bj/958c35a12ca4487bad2086347040a89e" returned: 0 in 0.722s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Snapshot extracted, beginning image upload
Jul 26 17:03:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Snapshot image upload complete
Jul 26 17:03:24 user nova-compute[70594]: INFO nova.compute.manager [None req-981fef4e-0cf7-4dda-ad08-ebb7571c11a5 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Took 6.69 seconds to snapshot the instance on the hypervisor.
Jul 26 17:03:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:37 user nova-compute[70594]: INFO nova.compute.manager [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Terminating instance
Jul 26 17:03:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-d016d2f0-d743-4593-9ab4-4fc0a4e98db1 req-5e2fcf30-02e9-4e2f-b96b-3b808635ba06 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-vif-unplugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d016d2f0-d743-4593-9ab4-4fc0a4e98db1 req-5e2fcf30-02e9-4e2f-b96b-3b808635ba06 service nova] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d016d2f0-d743-4593-9ab4-4fc0a4e98db1 req-5e2fcf30-02e9-4e2f-b96b-3b808635ba06 service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d016d2f0-d743-4593-9ab4-4fc0a4e98db1 req-5e2fcf30-02e9-4e2f-b96b-3b808635ba06 service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-d016d2f0-d743-4593-9ab4-4fc0a4e98db1 req-5e2fcf30-02e9-4e2f-b96b-3b808635ba06 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] No waiting events found dispatching network-vif-unplugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-d016d2f0-d743-4593-9ab4-4fc0a4e98db1 req-5e2fcf30-02e9-4e2f-b96b-3b808635ba06 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-vif-unplugged-0896e71c-3bc7-4005-8b4f-d24002883a99 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:03:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Instance destroyed successfully.
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'resources' on Instance uuid dcfcdd0b-bff7-40d0-b924-daffc40e43e1 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1736520187',display_name='tempest-VolumesAdminNegativeTest-server-1736520187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1736520187',id=16,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74144c8b9bb4410983f5b3b496a1aa87',ramdisk_id='',reservation_id='r-4k9sbgx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2053670578',owner_user_name='tempest-VolumesAdminNegativeTest-2053670578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:01:46Z,user_data=None,user_id='f4ffde3f244e4ac1923e33f7a9f048ec',uuid=dcfcdd0b-bff7-40d0-b924-daffc40e43e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converting VIF {"id": "0896e71c-3bc7-4005-8b4f-d24002883a99", "address": "fa:16:3e:c1:ae:ac", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0896e71c-3b", "ovs_interfaceid": "0896e71c-3bc7-4005-8b4f-d24002883a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG os_vif [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0896e71c-3b, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:03:38 user nova-compute[70594]: INFO os_vif [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ae:ac,bridge_name='br-int',has_traffic_filtering=True,id=0896e71c-3bc7-4005-8b4f-d24002883a99,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0896e71c-3b')
Jul 26 17:03:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Deleting instance files /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1_del
Jul 26 17:03:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Deletion of /opt/stack/data/nova/instances/dcfcdd0b-bff7-40d0-b924-daffc40e43e1_del complete
Jul 26 17:03:38 user nova-compute[70594]: INFO nova.compute.manager [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 26 17:03:38 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:03:38 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Took 0.47 seconds to deallocate network for instance.
Jul 26 17:03:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-943c2138-ba71-48f9-b7ff-afc2d06f6fa5 req-81f4575d-6fe0-437a-a4fb-0785bafc0335 service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-vif-deleted-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:39 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:03:39 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:03:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:39 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Deleted allocations for instance dcfcdd0b-bff7-40d0-b924-daffc40e43e1
Jul 26 17:03:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-59e1f1d3-2687-495e-8bfe-f44b3bb342d2 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.752s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:40 user nova-compute[70594]: DEBUG nova.compute.manager [req-f358c181-0206-400a-8c67-ab747d4bde08 req-ccb61203-2f6f-463b-b046-d9546f6d1a7c service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received event network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:03:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f358c181-0206-400a-8c67-ab747d4bde08 req-ccb61203-2f6f-463b-b046-d9546f6d1a7c service nova] Acquiring lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f358c181-0206-400a-8c67-ab747d4bde08 req-ccb61203-2f6f-463b-b046-d9546f6d1a7c service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f358c181-0206-400a-8c67-ab747d4bde08 req-ccb61203-2f6f-463b-b046-d9546f6d1a7c service nova] Lock "dcfcdd0b-bff7-40d0-b924-daffc40e43e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:40 user nova-compute[70594]: DEBUG nova.compute.manager [req-f358c181-0206-400a-8c67-ab747d4bde08 req-ccb61203-2f6f-463b-b046-d9546f6d1a7c service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] No waiting events found dispatching network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:03:40 user nova-compute[70594]: WARNING nova.compute.manager [req-f358c181-0206-400a-8c67-ab747d4bde08 req-ccb61203-2f6f-463b-b046-d9546f6d1a7c service nova] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Received unexpected event network-vif-plugged-0896e71c-3bc7-4005-8b4f-d24002883a99 for instance with vm_state deleted and task_state None.
Jul 26 17:03:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 17:03:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391018.2363307, dcfcdd0b-bff7-40d0-b924-daffc40e43e1 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:03:53 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] VM Stopped (Lifecycle Event)
Jul 26 17:03:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c488b8d-864b-4d1a-8b4b-73ff4d83281c None None] [instance: dcfcdd0b-bff7-40d0-b924-daffc40e43e1] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:03:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:56 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:57 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:58 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:03:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:03:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:03:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:03:58 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:03:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:00 user nova-compute[70594]: INFO nova.compute.manager [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Detaching volume 166a5665-5d42-4e94-ab45-431bfcb60992
Jul 26 17:04:00 user nova-compute[70594]: INFO nova.virt.block_device [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Attempting to driver detach volume 166a5665-5d42-4e94-ab45-431bfcb60992 from mountpoint /dev/vdc
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Attempting to detach device vdc from instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:04:00 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:00 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:04:00 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:04:00 user nova-compute[70594]:   <serial>166a5665-5d42-4e94-ab45-431bfcb60992</serial>
Jul 26 17:04:00 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:04:00 user nova-compute[70594]: </disk>
Jul 26 17:04:00 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully detached device vdc from instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 from the persistent domain config.
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:04:00 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:00 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:04:00 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:04:00 user nova-compute[70594]:   <serial>166a5665-5d42-4e94-ab45-431bfcb60992</serial>
Jul 26 17:04:00 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:04:00 user nova-compute[70594]: </disk>
Jul 26 17:04:00 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391040.876409, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:04:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully detached device vdc from instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 from the live domain config.
Jul 26 17:04:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbXNqrKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:00 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d2f76-594b-412d-86b3-8119ff2186a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:04:00 user nova-compute[70594]: No targets found.
Jul 26 17:04:00 user nova-compute[70594]: iSNS:
Jul 26 17:04:00 user nova-compute[70594]: No targets found.
Jul 26 17:04:00 user nova-compute[70594]: STATIC:
Jul 26 17:04:00 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:04:00 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:00 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:00 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:04:00 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:00 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:00 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992
Jul 26 17:04:00 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:00 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:00 user nova-compute[70594]: FIRMWARE:
Jul 26 17:04:00 user nova-compute[70594]: No targets found.
Jul 26 17:04:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:04:00 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:04:00 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9814c9-8576-4704-b6eb-5fa0dd248127]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c411f7e-0575-4464-8d56-3f52d25a9da1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:00 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:04:00 user nova-compute[70594]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:00 user nova-compute[70594]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 (non-flash)
Jul 26 17:04:00 user nova-compute[70594]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591036b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a29869b-f139-47a3-a235-f1c842b85700]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[18871d13-c2bd-41b5-bfce-af79b1abd9e0]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e244fdec-dc7b-469a-b81c-79ce3502bb5a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f56d5-702d-4400-b08b-c863d3e3aa9a]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf22823-4f2e-45d1-b45a-ad298e1f3da0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a6ec3c-ddd3-4d08-ba53-7ec18f5beec3]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260]
Jul 26 17:04:01 user nova-compute[70594]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:166a5665-5d42-4e94-ab45-431bfcb60992 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d15c86-5e82-44ec-83d4-752eded45603]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] <== disconnect_volume: return (410ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG nova.objects.instance [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'flavor' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cc4a91d7-27fd-4fe2-bd73-57ec4ebcae68 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.139s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:03 user nova-compute[70594]: INFO nova.compute.manager [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Unrescuing
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'flavor' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:04 user nova-compute[70594]: INFO nova.compute.manager [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Attaching volume 72234be1-34b2-484c-b2f2-709fa1d72bad to /dev/vdb
Jul 26 17:04:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=6964MB free_disk=25.303253173828125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb39748-ef18-4f18-b4bb-a262e9027b47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a8931d-e046-4d9f-a03d-16d6d798e590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Applying migration context for instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 as it has an incoming, in-progress migration 6693ef55-1704-409b-875a-29c0b64b6407. Migration status is reverting {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:987}}
Jul 26 17:04:04 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating resource usage from migration 6693ef55-1704-409b-875a-29c0b64b6407
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95b75b7-6124-4975-a852-04394907106a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fdb3e5-70c5-46f9-b169-8125d18656c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Port 87faecb4-e13b-455f-911b-2c9f9e614336 binding to destination host user is already ACTIVE {{(pid=70594) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:04 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:04:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be01564-3bb1-4862-a27e-e219f60d944d]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating existing volume attachment record: 90c2a5ad-e563-4c06-8aef-3ecd0bef64b3 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 76a02a97-4400-44d2-8655-89fc12f69682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Migration 6693ef55-1704-409b-875a-29c0b64b6407 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1674}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 17:04:04 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'flavor' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Creating tmpfile /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/tmpnzy99jv3 to verify with other compute node that the instance is on the same shared storage. {{(pid=70594) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.170s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-d05be4e5-150b-48d0-94ce-d1a773ccf212 req-d8bdea5f-1374-4256-94d3-5dbdd9f79206 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d05be4e5-150b-48d0-94ce-d1a773ccf212 req-d8bdea5f-1374-4256-94d3-5dbdd9f79206 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d05be4e5-150b-48d0-94ce-d1a773ccf212 req-d8bdea5f-1374-4256-94d3-5dbdd9f79206 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d05be4e5-150b-48d0-94ce-d1a773ccf212 req-d8bdea5f-1374-4256-94d3-5dbdd9f79206 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-d05be4e5-150b-48d0-94ce-d1a773ccf212 req-d8bdea5f-1374-4256-94d3-5dbdd9f79206 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:05 user nova-compute[70594]: WARNING nova.compute.manager [req-d05be4e5-150b-48d0-94ce-d1a773ccf212 req-d8bdea5f-1374-4256-94d3-5dbdd9f79206 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing instance network info cache due to event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:05 user nova-compute[70594]: DEBUG nova.network.neutron [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-e5d96aab-c43e-4fe2-8f49-4d7afdb3b146 req-e9dd03eb-ccf0-4cdb-99ab-023c0e9f7182 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5d96aab-c43e-4fe2-8f49-4d7afdb3b146 req-e9dd03eb-ccf0-4cdb-99ab-023c0e9f7182 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5d96aab-c43e-4fe2-8f49-4d7afdb3b146 req-e9dd03eb-ccf0-4cdb-99ab-023c0e9f7182 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5d96aab-c43e-4fe2-8f49-4d7afdb3b146 req-e9dd03eb-ccf0-4cdb-99ab-023c0e9f7182 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-e5d96aab-c43e-4fe2-8f49-4d7afdb3b146 req-e9dd03eb-ccf0-4cdb-99ab-023c0e9f7182 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:06 user nova-compute[70594]: WARNING nova.compute.manager [req-e5d96aab-c43e-4fe2-8f49-4d7afdb3b146 req-e9dd03eb-ccf0-4cdb-99ab-023c0e9f7182 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state resized and task_state resize_reverting.
Jul 26 17:04:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance destroyed successfully.
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.network.neutron [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updated VIF entry in instance network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.network.neutron [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance destroyed successfully.
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'resources' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9e834752-0df6-4005-8831-3eec69dd0686 req-fd8c730a-f5cf-4106-849c-951274aec722 service nova] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87faecb4-e1, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:06 user nova-compute[70594]: INFO os_vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1')
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:06 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed8b5e-f087-47a5-a2ff-cbf2856aa460]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:04:06 user nova-compute[70594]: No targets found.
Jul 26 17:04:06 user nova-compute[70594]: iSNS:
Jul 26 17:04:06 user nova-compute[70594]: No targets found.
Jul 26 17:04:06 user nova-compute[70594]: STATIC:
Jul 26 17:04:06 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:04:06 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:06 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:06 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:04:06 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:06 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:06 user nova-compute[70594]: FIRMWARE:
Jul 26 17:04:06 user nova-compute[70594]: No targets found.
Jul 26 17:04:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:04:06 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:04:06 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7763f07b-b9b4-4b3e-8c9f-fd82161c675e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d7d65-7135-4ac0-9caf-1ff60fe6f2b8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:06 user nova-compute[70594]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:06 user nova-compute[70594]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59104c5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e545526-b889-4578-98e9-1a4eec3f8a63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f6589-7d54-4019-af46-d5b69183ee53]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78feb10c-4c78-4a5d-8ba0-238a090c79a8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96892e3-150a-4bf1-8a44-cb7e5094c4f2]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6df786-44d4-4620-bc60-feed6cdcd122]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[95335d82-3a65-42fa-89a7-cac22f579b3b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]
Jul 26 17:04:06 user nova-compute[70594]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f2848f-2bf5-490e-be47-5dc9eb08a95f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== disconnect_volume: return (319ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-e3002e2b-5346-48d7-8b42-0eea261a56e7 req-60b45ae4-f622-4801-b213-d878bc0e5e97 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e3002e2b-5346-48d7-8b42-0eea261a56e7 req-60b45ae4-f622-4801-b213-d878bc0e5e97 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e3002e2b-5346-48d7-8b42-0eea261a56e7 req-60b45ae4-f622-4801-b213-d878bc0e5e97 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e3002e2b-5346-48d7-8b42-0eea261a56e7 req-60b45ae4-f622-4801-b213-d878bc0e5e97 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-e3002e2b-5346-48d7-8b42-0eea261a56e7 req-60b45ae4-f622-4801-b213-d878bc0e5e97 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:07 user nova-compute[70594]: WARNING nova.compute.manager [req-e3002e2b-5346-48d7-8b42-0eea261a56e7 req-60b45ae4-f622-4801-b213-d878bc0e5e97 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing instance network info cache due to event network-changed-f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] Acquiring lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] Acquired lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:07 user nova-compute[70594]: DEBUG nova.network.neutron [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Refreshing network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-c45925a9-3327-4da2-acee-1d81c6749e20 req-5b62a27a-a850-4ba9-ac8d-8d78684c1b58 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c45925a9-3327-4da2-acee-1d81c6749e20 req-5b62a27a-a850-4ba9-ac8d-8d78684c1b58 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c45925a9-3327-4da2-acee-1d81c6749e20 req-5b62a27a-a850-4ba9-ac8d-8d78684c1b58 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c45925a9-3327-4da2-acee-1d81c6749e20 req-5b62a27a-a850-4ba9-ac8d-8d78684c1b58 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-c45925a9-3327-4da2-acee-1d81c6749e20 req-5b62a27a-a850-4ba9-ac8d-8d78684c1b58 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:08 user nova-compute[70594]: WARNING nova.compute.manager [req-c45925a9-3327-4da2-acee-1d81c6749e20 req-5b62a27a-a850-4ba9-ac8d-8d78684c1b58 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state resized and task_state resize_reverting.
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.network.neutron [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updated VIF entry in instance network info cache for port f057bd54-b76f-4591-a8a7-b97bdb536421. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.network.neutron [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [{"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-603e5e37-68bf-4e12-9ca7-061af0ee2727 req-cccd088a-0be5-483c-bd96-2777d7141caa service nova] Releasing lock "refresh_cache-3f5841c2-e400-48d9-92dd-d776150c7849" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:08 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'migration_context' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.613s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:09 user nova-compute[70594]: INFO nova.compute.manager [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Swapping old allocation on dict_keys(['e707ce86-5823-47be-ae04-864d58aeb2e9']) held by migration 6693ef55-1704-409b-875a-29c0b64b6407 for instance
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.compute.manager [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.compute.manager [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:09 user nova-compute[70594]: WARNING nova.compute.manager [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.compute.manager [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.compute.manager [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:09 user nova-compute[70594]: WARNING nova.compute.manager [req-af0a2f53-adad-465d-9eef-0f7e20a91e5d req-3976267a-1a1c-4207-b9f8-786bd674523e service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Overwriting current allocation {'allocations': {'e707ce86-5823-47be-ae04-864d58aeb2e9': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '4fbd171f41764f60b8abe257e5f6e2c2', 'user_id': '43c125b2ba334237878f2c655fed828a', 'consumer_generation': 1} on consumer a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquired lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 3f5841c2-e400-48d9-92dd-d776150c7849 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391050.240749, 3f5841c2-e400-48d9-92dd-d776150c7849 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:10 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Resumed (Lifecycle Event)
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a3e9e7b7-99cb-4637-9f3b-de37d8f6ae43 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:10 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391050.2446985, 3f5841c2-e400-48d9-92dd-d776150c7849 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:10 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Started (Lifecycle Event)
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Releasing lock "refresh_cache-a624beaa-5c38-4aee-9c04-4e888e85f0f9" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG os_brick.utils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb212dd-bec3-4ffd-892a-bf7b86ec5260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd181b-0b5f-4ee7-a737-c076a53c89b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f4bc4b-d5cd-4441-999c-6e5e04e982c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[76df5d3a-699a-48c0-b3de-5fcac761679d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:11 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:04:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c803e8-2575-4d03-b6d5-976bc3f2ffcb]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG os_brick.utils [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:12 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:12 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:12 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a02df4-1362-4e69-acc2-c2a156f277ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:04:12 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[649dc40b-38ee-4c1e-94f8-a0bc99e8cb3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad] added
Jul 26 17:04:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d456e3f-5860-430b-a622-f73dae3ca215]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[11071764-e41b-4ebc-a1c8-9ff26916928f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWFrXZDh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWFrXZDh" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cf0085-6179-47a7-a5a2-7c5582c3c138]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yWFrXZDh'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c7554-c58d-46de-8409-edb5c5a8b9f1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e17d9c-2789-4966-bed9-f950c8865a29]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8057e1b-daa9-4f29-8f84-cad14af2b264]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]
Jul 26 17:04:12 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[118727fb-e5a3-400a-93f9-ee0e3dcd1e55]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a594e-beb3-4d48-8edb-33ce5d5ff687]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:12 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:12 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4575f6e-6981-456f-8d2c-0c6cb2d40bfa]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:04:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23966343562386235', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966343562386235', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'flavor' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:04:13 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:13 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:04:13 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:04:13 user nova-compute[70594]:   <serial>72234be1-34b2-484c-b2f2-709fa1d72bad</serial>
Jul 26 17:04:13 user nova-compute[70594]: </disk>
Jul 26 17:04:13 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No VIF found with MAC fa:16:3e:70:78:e9, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:04:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bbab6c7e-0145-47af-9bda-2ee2eebacade tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.905s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-changed-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Refreshing instance network info cache due to event network-changed-63fbb581-4956-4207-be9e-689d6b22104d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] Acquiring lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] Acquired lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:16 user nova-compute[70594]: DEBUG nova.network.neutron [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Refreshing network info cache for port 63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "interface-f2b78e55-2422-4aa4-9cc7-cec7a964d901-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "interface-f2b78e55-2422-4aa4-9cc7-cec7a964d901-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'flavor' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.network.neutron [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updated VIF entry in instance network info cache for port 63fbb581-4956-4207-be9e-689d6b22104d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.network.neutron [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'pci_requests' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4c7310f1-7009-4159-abb8-158fe38de2ef req-69671476-aed0-4052-b3af-cdd7ee2d0ca3 service nova] Releasing lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.policy [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '472502ad99de4e669f2adb09afefe2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae4c76df80df42b0b4744e11d2f61b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:04:18 user nova-compute[70594]: INFO nova.compute.claims [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Claim successful on node user
Jul 26 17:04:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Successfully created port: 41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:04:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:04:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.policy [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19534391163c45e0ad05fda800596c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a605e82d564b7db062971ba2762482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:04:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Creating image(s)
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "/opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "/opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk 1073741824" returned: 0 in 0.061s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Cannot resize image /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.objects.instance [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lazy-loading 'migration_context' on Instance uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Ensure instance console log exists: /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Successfully updated port: 41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquired lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-changed-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Refreshing instance network info cache due to event network-changed-41f246a2-150f-4ead-98ce-b3de2bb60dc2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] Acquiring lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Starting finish_revert_migration {{(pid=70594) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start _get_guest_xml network_info=[{"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a624beaa-5c38-4aee-9c04-4e888e85f0f9', 'attached_at': '2023-07-26T17:04:20.000000', 'detached_at': '', 'volume_id': 'aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'serial': 'aa9af32a-f17c-4993-b3b2-9b1e89a6aac9'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'b1da213a-22ca-4035-8682-2f025964886c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:04:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'vcpu_model' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:20 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd785c2-37f7-430b-8036-3485e922c91f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:04:20 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc757197-457f-4e70-94ec-5825d98af988]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9] added
Jul 26 17:04:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8ecb9-3dd5-486b-a096-d447a9e3118e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c033352-6658-451d-bf06-45e29e86fe12]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdcHDxBP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdcHDxBP" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf6509b-8c23-4656-a143-04f78642c680]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdcHDxBP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6938926-d6e8-4061-a12a-05e3f649d9d1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df0dab-b998-4ae6-aa0b-917f6f4a38c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:20 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:20 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f945648-1bde-4cbc-9b73-cb678dc0aeeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]
Jul 26 17:04:20 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Successfully created port: 8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc5a17-e16e-4c02-a40a-2ac0a36f807b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[73482419-6401-412a-9cdb-39ecf4d5694c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:20 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:20 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:20 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:20 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a49f2-3277-49a0-a84d-a7a4e33ef2be]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:04:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391046.2557008, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:21 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Stopped (Lifecycle Event)
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-43707baa-73b8-4703-97ff-31208c032b37 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Releasing lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] Acquired lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.neutron [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Refreshing network info cache for port 41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG os_vif [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41f246a2-15, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41f246a2-15, col_values=(('external_ids', {'iface-id': '41f246a2-150f-4ead-98ce-b3de2bb60dc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:f1:3a', 'vm-uuid': 'f2b78e55-2422-4aa4-9cc7-cec7a964d901'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: INFO os_vif [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15')
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] attach device xml: <interface type="ethernet">
Jul 26 17:04:21 user nova-compute[70594]:   <mac address="fa:16:3e:5c:f1:3a"/>
Jul 26 17:04:21 user nova-compute[70594]:   <model type="virtio"/>
Jul 26 17:04:21 user nova-compute[70594]:   <mtu size="1442"/>
Jul 26 17:04:21 user nova-compute[70594]:   <target dev="tap41f246a2-15"/>
Jul 26 17:04:21 user nova-compute[70594]: </interface>
Jul 26 17:04:21 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23530626331663662', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530626331663662', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:04:21 user nova-compute[70594]:   <uuid>a624beaa-5c38-4aee-9c04-4e888e85f0f9</uuid>
Jul 26 17:04:21 user nova-compute[70594]:   <name>instance-00000006</name>
Jul 26 17:04:21 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:04:21 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:04:21 user nova-compute[70594]:   <metadata>
Jul 26 17:04:21 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:21 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:04:21 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherB-server-478314950</nova:name>
Jul 26 17:04:21 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:04:20</nova:creationTime>
Jul 26 17:04:21 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:04:21 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:21 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:04:21 user nova-compute[70594]:       <nova:owner>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:user uuid="43c125b2ba334237878f2c655fed828a">tempest-ServerActionsTestOtherB-1823585199-project-member</nova:user>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:project uuid="4fbd171f41764f60b8abe257e5f6e2c2">tempest-ServerActionsTestOtherB-1823585199</nova:project>
Jul 26 17:04:21 user nova-compute[70594]:       </nova:owner>
Jul 26 17:04:21 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:21 user nova-compute[70594]:       <nova:ports>
Jul 26 17:04:21 user nova-compute[70594]:         <nova:port uuid="87faecb4-e13b-455f-911b-2c9f9e614336">
Jul 26 17:04:21 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:04:21 user nova-compute[70594]:         </nova:port>
Jul 26 17:04:21 user nova-compute[70594]:       </nova:ports>
Jul 26 17:04:21 user nova-compute[70594]:     </nova:instance>
Jul 26 17:04:21 user nova-compute[70594]:   </metadata>
Jul 26 17:04:21 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:04:21 user nova-compute[70594]:     <system>
Jul 26 17:04:21 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:04:21 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:04:21 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:04:21 user nova-compute[70594]:       <entry name="serial">a624beaa-5c38-4aee-9c04-4e888e85f0f9</entry>
Jul 26 17:04:21 user nova-compute[70594]:       <entry name="uuid">a624beaa-5c38-4aee-9c04-4e888e85f0f9</entry>
Jul 26 17:04:21 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:04:21 user nova-compute[70594]:     </system>
Jul 26 17:04:21 user nova-compute[70594]:   </sysinfo>
Jul 26 17:04:21 user nova-compute[70594]:   <os>
Jul 26 17:04:21 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:04:21 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:04:21 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:04:21 user nova-compute[70594]:   </os>
Jul 26 17:04:21 user nova-compute[70594]:   <features>
Jul 26 17:04:21 user nova-compute[70594]:     <acpi/>
Jul 26 17:04:21 user nova-compute[70594]:     <apic/>
Jul 26 17:04:21 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:04:21 user nova-compute[70594]:   </features>
Jul 26 17:04:21 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:04:21 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:04:21 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:04:21 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:04:21 user nova-compute[70594]:   </clock>
Jul 26 17:04:21 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:04:21 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:04:21 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:04:21 user nova-compute[70594]:   </cpu>
Jul 26 17:04:21 user nova-compute[70594]:   <devices>
Jul 26 17:04:21 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:04:21 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:04:21 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk"/>
Jul 26 17:04:21 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:04:21 user nova-compute[70594]:     </disk>
Jul 26 17:04:21 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:04:21 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:21 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:04:21 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:04:21 user nova-compute[70594]:       <serial>aa9af32a-f17c-4993-b3b2-9b1e89a6aac9</serial>
Jul 26 17:04:21 user nova-compute[70594]:     </disk>
Jul 26 17:04:21 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:04:21 user nova-compute[70594]:       <mac address="fa:16:3e:be:a5:cb"/>
Jul 26 17:04:21 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:21 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:04:21 user nova-compute[70594]:       <target dev="tap87faecb4-e1"/>
Jul 26 17:04:21 user nova-compute[70594]:     </interface>
Jul 26 17:04:21 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:04:21 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/console.log" append="off"/>
Jul 26 17:04:21 user nova-compute[70594]:     </serial>
Jul 26 17:04:21 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:04:21 user nova-compute[70594]:     <video>
Jul 26 17:04:21 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:21 user nova-compute[70594]:     </video>
Jul 26 17:04:21 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:04:21 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:04:21 user nova-compute[70594]:     </rng>
Jul 26 17:04:21 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:04:21 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:04:21 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:04:21 user nova-compute[70594]:     </memballoon>
Jul 26 17:04:21 user nova-compute[70594]:   </devices>
Jul 26 17:04:21 user nova-compute[70594]: </domain>
Jul 26 17:04:21 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG os_vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87faecb4-e1, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87faecb4-e1, col_values=(('external_ids', {'iface-id': '87faecb4-e13b-455f-911b-2c9f9e614336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:a5:cb', 'vm-uuid': 'a624beaa-5c38-4aee-9c04-4e888e85f0f9'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:22 user nova-compute[70594]: INFO os_vif [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1')
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No BDM found with device name hda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No VIF found with MAC fa:16:3e:85:13:20, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:22 user nova-compute[70594]:   <nova:package version="0.0.0"/>
Jul 26 17:04:22 user nova-compute[70594]:   <nova:name>tempest-device-tagging-server-1535981382</nova:name>
Jul 26 17:04:22 user nova-compute[70594]:   <nova:creationTime>2023-07-26 17:04:22</nova:creationTime>
Jul 26 17:04:22 user nova-compute[70594]:   <nova:flavor name="m1.tiny">
Jul 26 17:04:22 user nova-compute[70594]:     <nova:memory>512</nova:memory>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:disk>1</nova:disk>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:swap>0</nova:swap>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:22 user nova-compute[70594]:   </nova:flavor>
Jul 26 17:04:22 user nova-compute[70594]:   <nova:owner>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:user uuid="472502ad99de4e669f2adb09afefe2d4">tempest-TaggedAttachmentsTest-15597414-project-member</nova:user>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:project uuid="ae4c76df80df42b0b4744e11d2f61b04">tempest-TaggedAttachmentsTest-15597414</nova:project>
Jul 26 17:04:22 user nova-compute[70594]:   </nova:owner>
Jul 26 17:04:22 user nova-compute[70594]:   <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:22 user nova-compute[70594]:   <nova:ports>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:port uuid="63fbb581-4956-4207-be9e-689d6b22104d">
Jul 26 17:04:22 user nova-compute[70594]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:04:22 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:22 user nova-compute[70594]:     <nova:port uuid="41f246a2-150f-4ead-98ce-b3de2bb60dc2">
Jul 26 17:04:22 user nova-compute[70594]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Jul 26 17:04:22 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:22 user nova-compute[70594]:   </nova:ports>
Jul 26 17:04:22 user nova-compute[70594]: </nova:instance>
Jul 26 17:04:22 user nova-compute[70594]:  {{(pid=70594) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ec28605c-1794-42e9-8892-9c5a55516951 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "interface-f2b78e55-2422-4aa4-9cc7-cec7a964d901-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.234s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-8533736e-9ecb-495f-8454-8c78982fcde8 req-ace55be5-9936-449e-9172-33df1f79348e service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8533736e-9ecb-495f-8454-8c78982fcde8 req-ace55be5-9936-449e-9172-33df1f79348e service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8533736e-9ecb-495f-8454-8c78982fcde8 req-ace55be5-9936-449e-9172-33df1f79348e service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8533736e-9ecb-495f-8454-8c78982fcde8 req-ace55be5-9936-449e-9172-33df1f79348e service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-8533736e-9ecb-495f-8454-8c78982fcde8 req-ace55be5-9936-449e-9172-33df1f79348e service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:22 user nova-compute[70594]: WARNING nova.compute.manager [req-8533736e-9ecb-495f-8454-8c78982fcde8 req-ace55be5-9936-449e-9172-33df1f79348e service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 for instance with vm_state active and task_state None.
Jul 26 17:04:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Successfully updated port: 8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquired lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updated VIF entry in instance network info cache for port 41f246a2-150f-4ead-98ce-b3de2bb60dc2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dce40519-6e91-4962-93cf-b89c441c3fda req-f6aa496d-e44c-4527-bfac-0416729cb807 service nova] Releasing lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'flavor' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:23 user nova-compute[70594]: INFO nova.compute.manager [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Attaching volume 63f877c5-d8c4-4d5d-bb2b-7278b4646866 to /dev/vdb
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updating instance_info_cache with network_info: [{"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_brick.utils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Releasing lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Instance network_info: |[{"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Start _get_guest_xml network_info=[{"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc939732-8a5b-46f8-bd59-6df56943a5ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7552e012-6c42-4695-8610-142caf255c26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing instance network info cache due to event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592701d-e973-4513-ae99-bd316d52cb95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[681cfec9-10eb-4e75-b505-438fb7bd5c40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1962657',id=20,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD53vywkb9HORaVEZ5ZG7wVESHl3DqHyOC45QWCtPjl385LJWQj1Y0W2Ax+fBuRBQa36OBQ3htrmxU0R708SLT1YCgBRt1XtWUgtgTqcwtmO+B7PzOaxMWyE7LXPhJvhg==',key_name='tempest-keypair-1164210553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0a605e82d564b7db062971ba2762482',ramdisk_id='',reservation_id='r-c42pn88m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1248746572',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19534391163c45e0ad05fda800596c89',uuid=6ac8029d-1df8-4648-979f-8f4fee7fdab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Converting VIF {"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.objects.instance [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:23 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b6e2ac-c591-4c8e-a7a4-99af77921c39]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_brick.utils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating existing volume attachment record: 61d8be8b-9835-425c-8d02-12ec4aee315a {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:04:23 user nova-compute[70594]:   <uuid>6ac8029d-1df8-4648-979f-8f4fee7fdab4</uuid>
Jul 26 17:04:23 user nova-compute[70594]:   <name>instance-00000014</name>
Jul 26 17:04:23 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:04:23 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:04:23 user nova-compute[70594]:   <metadata>
Jul 26 17:04:23 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:23 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:04:23 user nova-compute[70594]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616</nova:name>
Jul 26 17:04:23 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:04:23</nova:creationTime>
Jul 26 17:04:23 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:04:23 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:23 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:04:23 user nova-compute[70594]:       <nova:owner>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:user uuid="19534391163c45e0ad05fda800596c89">tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member</nova:user>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:project uuid="a0a605e82d564b7db062971ba2762482">tempest-TestServerVolumeAttachScenarioOldVersion-1248746572</nova:project>
Jul 26 17:04:23 user nova-compute[70594]:       </nova:owner>
Jul 26 17:04:23 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:23 user nova-compute[70594]:       <nova:ports>
Jul 26 17:04:23 user nova-compute[70594]:         <nova:port uuid="8e748cd0-1b6b-4407-835c-2f923babe6a5">
Jul 26 17:04:23 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:04:23 user nova-compute[70594]:         </nova:port>
Jul 26 17:04:23 user nova-compute[70594]:       </nova:ports>
Jul 26 17:04:23 user nova-compute[70594]:     </nova:instance>
Jul 26 17:04:23 user nova-compute[70594]:   </metadata>
Jul 26 17:04:23 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:04:23 user nova-compute[70594]:     <system>
Jul 26 17:04:23 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:04:23 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:04:23 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:04:23 user nova-compute[70594]:       <entry name="serial">6ac8029d-1df8-4648-979f-8f4fee7fdab4</entry>
Jul 26 17:04:23 user nova-compute[70594]:       <entry name="uuid">6ac8029d-1df8-4648-979f-8f4fee7fdab4</entry>
Jul 26 17:04:23 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:04:23 user nova-compute[70594]:     </system>
Jul 26 17:04:23 user nova-compute[70594]:   </sysinfo>
Jul 26 17:04:23 user nova-compute[70594]:   <os>
Jul 26 17:04:23 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:04:23 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:04:23 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:04:23 user nova-compute[70594]:   </os>
Jul 26 17:04:23 user nova-compute[70594]:   <features>
Jul 26 17:04:23 user nova-compute[70594]:     <acpi/>
Jul 26 17:04:23 user nova-compute[70594]:     <apic/>
Jul 26 17:04:23 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:04:23 user nova-compute[70594]:   </features>
Jul 26 17:04:23 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:04:23 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:04:23 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:04:23 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:04:23 user nova-compute[70594]:   </clock>
Jul 26 17:04:23 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:04:23 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:04:23 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:04:23 user nova-compute[70594]:   </cpu>
Jul 26 17:04:23 user nova-compute[70594]:   <devices>
Jul 26 17:04:23 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:04:23 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:04:23 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk"/>
Jul 26 17:04:23 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:04:23 user nova-compute[70594]:     </disk>
Jul 26 17:04:23 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:04:23 user nova-compute[70594]:       <mac address="fa:16:3e:5a:d0:9e"/>
Jul 26 17:04:23 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:23 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:04:23 user nova-compute[70594]:       <target dev="tap8e748cd0-1b"/>
Jul 26 17:04:23 user nova-compute[70594]:     </interface>
Jul 26 17:04:23 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:04:23 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/console.log" append="off"/>
Jul 26 17:04:23 user nova-compute[70594]:     </serial>
Jul 26 17:04:23 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:04:23 user nova-compute[70594]:     <video>
Jul 26 17:04:23 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:23 user nova-compute[70594]:     </video>
Jul 26 17:04:23 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:04:23 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:04:23 user nova-compute[70594]:     </rng>
Jul 26 17:04:23 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:04:23 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:04:23 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:04:23 user nova-compute[70594]:     </memballoon>
Jul 26 17:04:23 user nova-compute[70594]:   </devices>
Jul 26 17:04:23 user nova-compute[70594]: </domain>
Jul 26 17:04:23 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1962657',id=20,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD53vywkb9HORaVEZ5ZG7wVESHl3DqHyOC45QWCtPjl385LJWQj1Y0W2Ax+fBuRBQa36OBQ3htrmxU0R708SLT1YCgBRt1XtWUgtgTqcwtmO+B7PzOaxMWyE7LXPhJvhg==',key_name='tempest-keypair-1164210553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0a605e82d564b7db062971ba2762482',ramdisk_id='',reservation_id='r-c42pn88m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1248746572',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19534391163c45e0ad05fda800596c89',uuid=6ac8029d-1df8-4648-979f-8f4fee7fdab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Converting VIF {"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG os_vif [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e748cd0-1b, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e748cd0-1b, col_values=(('external_ids', {'iface-id': '8e748cd0-1b6b-4407-835c-2f923babe6a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:d0:9e', 'vm-uuid': '6ac8029d-1df8-4648-979f-8f4fee7fdab4'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: INFO os_vif [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b')
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] No VIF found with MAC fa:16:3e:5a:d0:9e, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-fc0178f4-be48-4e6c-97d4-ff14e01dc7b2 req-cc8da0f7-d8ce-4b67-aa68-84142a3f4d6e service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fc0178f4-be48-4e6c-97d4-ff14e01dc7b2 req-cc8da0f7-d8ce-4b67-aa68-84142a3f4d6e service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fc0178f4-be48-4e6c-97d4-ff14e01dc7b2 req-cc8da0f7-d8ce-4b67-aa68-84142a3f4d6e service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fc0178f4-be48-4e6c-97d4-ff14e01dc7b2 req-cc8da0f7-d8ce-4b67-aa68-84142a3f4d6e service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-fc0178f4-be48-4e6c-97d4-ff14e01dc7b2 req-cc8da0f7-d8ce-4b67-aa68-84142a3f4d6e service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:23 user nova-compute[70594]: WARNING nova.compute.manager [req-fc0178f4-be48-4e6c-97d4-ff14e01dc7b2 req-cc8da0f7-d8ce-4b67-aa68-84142a3f4d6e service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state resized and task_state resize_reverting.
Jul 26 17:04:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updated VIF entry in instance network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cf6dc322-280d-4810-8772-7186d0865bc5 req-7fcd848b-214c-4453-b67c-1966b71b06b8 service nova] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-changed-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Refreshing instance network info cache due to event network-changed-8e748cd0-1b6b-4407-835c-2f923babe6a5. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] Acquiring lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] Acquired lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Refreshing network info cache for port 8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updated VIF entry in instance network info cache for port 8e748cd0-1b6b-4407-835c-2f923babe6a5. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updating instance_info_cache with network_info: [{"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] Releasing lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:25 user nova-compute[70594]: WARNING nova.compute.manager [req-907a48a8-48d0-4cf3-b3f2-4d2c48491f06 req-2c94f2b5-a329-46d7-8d1c-26d57ceb060c service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 for instance with vm_state active and task_state None.
Jul 26 17:04:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:25 user nova-compute[70594]: WARNING nova.compute.manager [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state resized and task_state resize_reverting.
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] No waiting events found dispatching network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:25 user nova-compute[70594]: WARNING nova.compute.manager [req-c8939f8b-21f5-4e10-941a-1463ac7577dd req-970305a1-84cd-4d04-b9e0-5b8d0a3f7ce9 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received unexpected event network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 for instance with vm_state building and task_state spawning.
Jul 26 17:04:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing instance network info cache due to event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updated VIF entry in instance network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-94c0830e-1021-4b50-bdb8-272c960c1969 req-9f503bda-27a9-4eea-930c-4b36d39383a1 service nova] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391067.5939016, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Resumed (Lifecycle Event)
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance running successfully.
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] finish_revert_migration finished successfully. {{(pid=70594) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391067.5968635, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Started (Lifecycle Event)
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.claims [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Claim successful on node user
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.manager [None req-5d703a11-38f5-4cad-9788-de12a8fcb9cf tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance to original state: 'active'
Jul 26 17:04:27 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391067.9947422, 6ac8029d-1df8-4648-979f-8f4fee7fdab4 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] VM Resumed (Lifecycle Event)
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Instance spawned successfully.
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8a533c6-7885-4bf9-a575-63076c14bc61 req-09852163-d336-442c-b0e6-08f6ec9b271b service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8a533c6-7885-4bf9-a575-63076c14bc61 req-09852163-d336-442c-b0e6-08f6ec9b271b service nova] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8a533c6-7885-4bf9-a575-63076c14bc61 req-09852163-d336-442c-b0e6-08f6ec9b271b service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8a533c6-7885-4bf9-a575-63076c14bc61 req-09852163-d336-442c-b0e6-08f6ec9b271b service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8a533c6-7885-4bf9-a575-63076c14bc61 req-09852163-d336-442c-b0e6-08f6ec9b271b service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] No waiting events found dispatching network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:28 user nova-compute[70594]: WARNING nova.compute.manager [req-c8a533c6-7885-4bf9-a575-63076c14bc61 req-09852163-d336-442c-b0e6-08f6ec9b271b service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received unexpected event network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 for instance with vm_state building and task_state spawning.
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391067.999023, 6ac8029d-1df8-4648-979f-8f4fee7fdab4 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] VM Started (Lifecycle Event)
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Took 9.08 seconds to spawn the instance on the hypervisor.
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.compute.manager [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Took 10.32 seconds to build instance.
Jul 26 17:04:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-21be9637-6a13-422a-84c1-83286cedc587 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.458s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:04:28 user nova-compute[70594]: INFO nova.virt.block_device [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Booting with blank volume at /dev/vda
Jul 26 17:04:28 user nova-compute[70594]: DEBUG nova.policy [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6af9ec8d9d644c89ba32c10861afba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd253357a8f7b42119a7b91385afa0e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:04:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Successfully created port: 62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Successfully updated port: 62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-changed-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Refreshing instance network info cache due to event network-changed-62446ba5-f54c-433c-91c2-b5f430eccc3a. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] Acquiring lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG nova.network.neutron [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance network_info: |[{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] Acquired lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG nova.network.neutron [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Refreshing network info cache for port 62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG nova.network.neutron [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updated VIF entry in instance network info cache for port 62446ba5-f54c-433c-91c2-b5f430eccc3a. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG nova.network.neutron [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c3fc617-c3c8-4374-917d-1c6fba0c5e8f req-fc7cec72-3cef-4891-a6e3-fa324cd621e6 service nova] Releasing lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YScrAPoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:32 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908bc12-b18b-4629-bba1-257bc377b4bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:04:32 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5989de0e-01bc-448d-8d28-a9dd3cac4dcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866] added
Jul 26 17:04:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.081s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1a473-56bd-4c2f-a3f0-f768989af31f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb9190f-b645-4727-89b8-5f9b74ab67c4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YScrAPoW {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YScrAPoW" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b99da-a2f9-46ab-be8f-7b8c4e0d3401]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YScrAPoW'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.143s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3896105-69e3-45da-9411-100a43b38093]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d21fe9-9b66-4d56-91b4-4295bcf46246]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:32 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:32 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:32 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:32 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --login" returned: 0 in 0.210s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a59593-ea75-4e64-b636-1d11ecdd0af4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260]
Jul 26 17:04:33 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.077s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b8b08-0ae6-4fe7-a11f-23cf1db8d0ae]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc2b4d-8802-4199-9105-8c5b1227f8e8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:33 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:33 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:33 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:33 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:33 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:33 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.910s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[012087bf-aefb-4bae-a8a1-dea098aafca5]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:33 user nova-compute[70594]: INFO nova.compute.manager [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Rebooting instance
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YScrAPoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.971s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] <== connect_volume: return (1974ms) {'type': 'block', 'scsi_wwn': '23834326261663263', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834326261663263', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.objects.instance [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'flavor' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:04:34 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:34 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:04:34 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:04:34 user nova-compute[70594]:   <serial>63f877c5-d8c4-4d5d-bb2b-7278b4646866</serial>
Jul 26 17:04:34 user nova-compute[70594]: </disk>
Jul 26 17:04:34 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.utils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8874957c-8333-4d8b-aeac-52ddbb20d1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77d665-51bb-4b5c-8fae-92bad2a91b00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd679c-ad11-463b-8ae1-4e37ae0ea51b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4815d9f-450c-4ac0-8d32-9750997b6965]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:34 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eced01-012a-43eb-b03b-ca1371ec21b6]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG os_brick.utils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating existing volume attachment record: 71883000-97f6-4dc4-826e-1fc403cb719f {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No BDM found with device name hda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] No VIF found with MAC fa:16:3e:85:13:20, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-d099ee22-2008-420e-a019-03709bcb2497 req-363d56e4-4402-49fb-9327-09cf5b1e62ca service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-unplugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d099ee22-2008-420e-a019-03709bcb2497 req-363d56e4-4402-49fb-9327-09cf5b1e62ca service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d099ee22-2008-420e-a019-03709bcb2497 req-363d56e4-4402-49fb-9327-09cf5b1e62ca service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d099ee22-2008-420e-a019-03709bcb2497 req-363d56e4-4402-49fb-9327-09cf5b1e62ca service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-d099ee22-2008-420e-a019-03709bcb2497 req-363d56e4-4402-49fb-9327-09cf5b1e62ca service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-unplugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:34 user nova-compute[70594]: WARNING nova.compute.manager [req-d099ee22-2008-420e-a019-03709bcb2497 req-363d56e4-4402-49fb-9327-09cf5b1e62ca service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-unplugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state active and task_state reboot_started_hard.
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:35 user nova-compute[70594]: INFO nova.compute.manager [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Terminating instance
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.compute.manager [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-253bdcb6-24f9-45bf-992c-60adc9da8e44 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.986s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance destroyed successfully.
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'resources' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-176363728',display_name='tempest-TestMinimumBasicScenario-server-176363728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-176363728',id=17,image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGke9iGOmvPqEKSh8QBz1Y0ruHXz1mdEoX5DAbsPsnYZuvHXRd09xN4lqJBepSsaJis60tn6XsdQ5erG81wBPM++LllZP3o1etQSYkKxJFvxlgTcLjIpEDXYCKw7/29ccQ==',key_name='tempest-TestMinimumBasicScenario-1758624021',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-b7tjwa5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:34Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=76a02a97-4400-44d2-8655-89fc12f69682,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf40ec4be-97, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: INFO os_vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97')
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:35 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1b7067-f47d-411f-ab4d-79e78da75697]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:04:35 user nova-compute[70594]: No targets found.
Jul 26 17:04:35 user nova-compute[70594]: iSNS:
Jul 26 17:04:35 user nova-compute[70594]: No targets found.
Jul 26 17:04:35 user nova-compute[70594]: STATIC:
Jul 26 17:04:35 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866
Jul 26 17:04:35 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:35 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:35 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:04:35 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:35 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:35 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad
Jul 26 17:04:35 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:35 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:35 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:04:35 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:35 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:35 user nova-compute[70594]: FIRMWARE:
Jul 26 17:04:35 user nova-compute[70594]: No targets found.
Jul 26 17:04:35 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:04:35 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:04:35 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c2703-662a-4b62-99cf-9764b29dd4ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[98203ede-6c8c-498e-8421-35a65255ad70]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:35 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:35 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:35 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:35 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:35 user nova-compute[70594]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:35 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:35 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:35 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59104c5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[847596f4-7af4-4b9f-a4ac-c3bb08c3bdd6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c5aa0-3282-4c38-aa0a-5c1bd90c0df1]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd037b4d-93ad-4b32-b339-56fb6b9d4cb5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad19025-c1bc-4edb-a8d7-45f04e383ae8]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f01b1-7c78-4362-bd9e-0f9622ba05d5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566754c-cdd0-4fd8-89c5-50d1b054678c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]
Jul 26 17:04:35 user nova-compute[70594]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:35 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef72e3-8141-4ed7-828f-f8affa097e58]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== disconnect_volume: return (452ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Instance destroyed successfully.
Jul 26 17:04:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.objects.instance [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lazy-loading 'resources' on Instance uuid a94a2105-0e19-4d03-bea8-f9e44b6d7f79 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Start _get_guest_xml network_info=[{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7dd870d3-b195-43da-a68e-0486554bcd2a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '7dd870d3-b195-43da-a68e-0486554bcd2a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '76a02a97-4400-44d2-8655-89fc12f69682', 'attached_at': '', 'detached_at': '', 'volume_id': '72234be1-34b2-484c-b2f2-709fa1d72bad', 'serial': '72234be1-34b2-484c-b2f2-709fa1d72bad'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '90c2a5ad-e563-4c06-8aef-3ecd0bef64b3', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-938206694',display_name='tempest-VolumesAdminNegativeTest-server-938206694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-938206694',id=9,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkaebApDzOXpyj2sQNxydXozvnDVQ6LtnA3r3FWZbZSc3dUS2C/uq4fIBcpOt1JcAtEX/KDbp9bygO9UQXJN1HbjAiqOdW+atUTH7HXhaWOKUg1MdObyCx14tiU1t8XRw==',key_name='tempest-keypair-227673292',keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74144c8b9bb4410983f5b3b496a1aa87',ramdisk_id='',reservation_id='r-usifwmif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2053670578',owner_user_name='tempest-VolumesAdminNegativeTest-2053670578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T16:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4ffde3f244e4ac1923e33f7a9f048ec',uuid=a94a2105-0e19-4d03-bea8-f9e44b6d7f79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converting VIF {"id": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "address": "fa:16:3e:d7:48:38", "network": {"id": "c499d7cc-dcfc-4b71-99e2-0698d2a74574", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1111838666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74144c8b9bb4410983f5b3b496a1aa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61bf6da5-c2", "ovs_interfaceid": "61bf6da5-c2af-40e5-85bb-d0d1154cc4a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_vif [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61bf6da5-c2, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:36 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:36 user nova-compute[70594]: INFO os_vif [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:48:38,bridge_name='br-int',has_traffic_filtering=True,id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5,network=Network(c499d7cc-dcfc-4b71-99e2-0698d2a74574),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61bf6da5-c2')
Jul 26 17:04:36 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Deleting instance files /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79_del
Jul 26 17:04:36 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Deletion of /opt/stack/data/nova/instances/a94a2105-0e19-4d03-bea8-f9e44b6d7f79_del complete
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7dd870d3-b195-43da-a68e-0486554bcd2a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:36 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:36 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:36 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d012c8-6015-4097-a9ed-801495ca3c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:04:36 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: INFO nova.compute.manager [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Took 1.09 seconds to destroy the instance on the hypervisor.
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03e9a2c-a5aa-4023-aeba-e2a18fd376b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad] added
Jul 26 17:04:36 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2138d293-dcdd-4f2d-97bc-c1443e624ada]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1ce81-e038-4144-8140-7e7357867798]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWFrXZDh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWFrXZDh" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ee009-6fc8-4f5f-bf2a-aef5bd0357b8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yWFrXZDh'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc02fb-6cc9-4ba7-a996-9856e604c7e9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9119401-297a-452d-969d-9caefda0da11]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea3541-7df9-4386-805d-aa91bf6a7837]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]
Jul 26 17:04:36 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:36 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd00d34f-cf3e-4efa-b2d8-5d8336455fa2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f649c9-7a65-404d-a266-c2c653196416]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:36 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:36 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:36 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60531e2-3283-40ae-9ea7-b3c7ba117b86]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:37 user nova-compute[70594]: WARNING nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state active and task_state reboot_started_hard.
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-unplugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-unplugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-unplugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:37 user nova-compute[70594]: WARNING nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state active and task_state deleting.
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:37 user nova-compute[70594]: WARNING nova.compute.manager [req-e9d957a7-b7bb-4cb0-90eb-a5373d24014e req-5f815be3-6422-492e-92c3-698551da5b16 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state active and task_state deleting.
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:37 user nova-compute[70594]: INFO nova.compute.manager [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Detaching volume 63f877c5-d8c4-4d5d-bb2b-7278b4646866
Jul 26 17:04:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23966343562386235', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966343562386235', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:04:37 user nova-compute[70594]: INFO nova.virt.block_device [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Attempting to driver detach volume 63f877c5-d8c4-4d5d-bb2b-7278b4646866 from mountpoint /dev/vdb
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Attempting to detach device vdb from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:04:37 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:37 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:04:37 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:04:37 user nova-compute[70594]:   <serial>63f877c5-d8c4-4d5d-bb2b-7278b4646866</serial>
Jul 26 17:04:37 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 26 17:04:37 user nova-compute[70594]: </disk>
Jul 26 17:04:37 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-176363728',display_name='tempest-TestMinimumBasicScenario-server-176363728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-176363728',id=17,image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGke9iGOmvPqEKSh8QBz1Y0ruHXz1mdEoX5DAbsPsnYZuvHXRd09xN4lqJBepSsaJis60tn6XsdQ5erG81wBPM++LllZP3o1etQSYkKxJFvxlgTcLjIpEDXYCKw7/29ccQ==',key_name='tempest-TestMinimumBasicScenario-1758624021',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-b7tjwa5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:34Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=76a02a97-4400-44d2-8655-89fc12f69682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully detached device vdb from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the persistent domain config.
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:04:37 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:37 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:04:37 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:04:37 user nova-compute[70594]:   <serial>63f877c5-d8c4-4d5d-bb2b-7278b4646866</serial>
Jul 26 17:04:37 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 26 17:04:37 user nova-compute[70594]: </disk>
Jul 26 17:04:37 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:04:37 user nova-compute[70594]:   <uuid>76a02a97-4400-44d2-8655-89fc12f69682</uuid>
Jul 26 17:04:37 user nova-compute[70594]:   <name>instance-00000011</name>
Jul 26 17:04:37 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:04:37 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:04:37 user nova-compute[70594]:   <metadata>
Jul 26 17:04:37 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:37 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:04:37 user nova-compute[70594]:       <nova:name>tempest-TestMinimumBasicScenario-server-176363728</nova:name>
Jul 26 17:04:37 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:04:36</nova:creationTime>
Jul 26 17:04:37 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:04:37 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:37 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:04:37 user nova-compute[70594]:       <nova:owner>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:user uuid="522b55c463ac450ebf618c8fdc44a8b5">tempest-TestMinimumBasicScenario-1770089512-project-member</nova:user>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:project uuid="549ece99958b4c54a8581fe37b3ced92">tempest-TestMinimumBasicScenario-1770089512</nova:project>
Jul 26 17:04:37 user nova-compute[70594]:       </nova:owner>
Jul 26 17:04:37 user nova-compute[70594]:       <nova:root type="image" uuid="7dd870d3-b195-43da-a68e-0486554bcd2a"/>
Jul 26 17:04:37 user nova-compute[70594]:       <nova:ports>
Jul 26 17:04:37 user nova-compute[70594]:         <nova:port uuid="f40ec4be-97e7-4bdf-a1aa-0be24286854b">
Jul 26 17:04:37 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 26 17:04:37 user nova-compute[70594]:         </nova:port>
Jul 26 17:04:37 user nova-compute[70594]:       </nova:ports>
Jul 26 17:04:37 user nova-compute[70594]:     </nova:instance>
Jul 26 17:04:37 user nova-compute[70594]:   </metadata>
Jul 26 17:04:37 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:04:37 user nova-compute[70594]:     <system>
Jul 26 17:04:37 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:04:37 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:04:37 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:04:37 user nova-compute[70594]:       <entry name="serial">76a02a97-4400-44d2-8655-89fc12f69682</entry>
Jul 26 17:04:37 user nova-compute[70594]:       <entry name="uuid">76a02a97-4400-44d2-8655-89fc12f69682</entry>
Jul 26 17:04:37 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:04:37 user nova-compute[70594]:     </system>
Jul 26 17:04:37 user nova-compute[70594]:   </sysinfo>
Jul 26 17:04:37 user nova-compute[70594]:   <os>
Jul 26 17:04:37 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:04:37 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:04:37 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:04:37 user nova-compute[70594]:   </os>
Jul 26 17:04:37 user nova-compute[70594]:   <features>
Jul 26 17:04:37 user nova-compute[70594]:     <acpi/>
Jul 26 17:04:37 user nova-compute[70594]:     <apic/>
Jul 26 17:04:37 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:04:37 user nova-compute[70594]:   </features>
Jul 26 17:04:37 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:04:37 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:04:37 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:04:37 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:04:37 user nova-compute[70594]:   </clock>
Jul 26 17:04:37 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:04:37 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:04:37 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:04:37 user nova-compute[70594]:   </cpu>
Jul 26 17:04:37 user nova-compute[70594]:   <devices>
Jul 26 17:04:37 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:04:37 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:04:37 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk"/>
Jul 26 17:04:37 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:04:37 user nova-compute[70594]:     </disk>
Jul 26 17:04:37 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:04:37 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:37 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 17:04:37 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:04:37 user nova-compute[70594]:       <serial>72234be1-34b2-484c-b2f2-709fa1d72bad</serial>
Jul 26 17:04:37 user nova-compute[70594]:     </disk>
Jul 26 17:04:37 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:04:37 user nova-compute[70594]:       <mac address="fa:16:3e:70:78:e9"/>
Jul 26 17:04:37 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:37 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:04:37 user nova-compute[70594]:       <target dev="tapf40ec4be-97"/>
Jul 26 17:04:37 user nova-compute[70594]:     </interface>
Jul 26 17:04:37 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:04:37 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/console.log" append="off"/>
Jul 26 17:04:37 user nova-compute[70594]:     </serial>
Jul 26 17:04:37 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:04:37 user nova-compute[70594]:     <video>
Jul 26 17:04:37 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:37 user nova-compute[70594]:     </video>
Jul 26 17:04:37 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:04:37 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:04:37 user nova-compute[70594]:     </rng>
Jul 26 17:04:37 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:04:37 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:04:37 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:04:37 user nova-compute[70594]:     </memballoon>
Jul 26 17:04:37 user nova-compute[70594]:   </devices>
Jul 26 17:04:37 user nova-compute[70594]: </domain>
Jul 26 17:04:37 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e76f355e-dd98-4c8a-883b-fbd39e250fb7 req-30fca0b3-6e83-4bb8-8063-518ba24cf531 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-deleted-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:37 user nova-compute[70594]: INFO nova.compute.manager [req-e76f355e-dd98-4c8a-883b-fbd39e250fb7 req-30fca0b3-6e83-4bb8-8063-518ba24cf531 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Neutron deleted interface 61bf6da5-c2af-40e5-85bb-d0d1154cc4a5; detaching it from the instance and deleting it from the info cache
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-e76f355e-dd98-4c8a-883b-fbd39e250fb7 req-30fca0b3-6e83-4bb8-8063-518ba24cf531 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:37 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Took 1.65 seconds to deallocate network for instance.
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e76f355e-dd98-4c8a-883b-fbd39e250fb7 req-30fca0b3-6e83-4bb8-8063-518ba24cf531 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Detach interface failed, port_id=61bf6da5-c2af-40e5-85bb-d0d1154cc4a5, reason: Instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:04:37 user nova-compute[70594]: INFO nova.compute.manager [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Detaching volume 55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:38 user nova-compute[70594]: INFO nova.virt.block_device [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Attempting to driver detach volume 55bfcd51-531a-48a7-9686-8253637a4d81 from mountpoint /dev/vdb
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391078.1031985, f2b78e55-2422-4aa4-9cc7-cec7a964d901 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:04:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully detached device vdb from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the live domain config.
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YScrAPoW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:38 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Attempting to detach device vdb from instance 3f5841c2-e400-48d9-92dd-d776150c7849 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:04:38 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:38 user nova-compute[70594]:   <source dev="/dev/sdb"/>
Jul 26 17:04:38 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:04:38 user nova-compute[70594]:   <serial>55bfcd51-531a-48a7-9686-8253637a4d81</serial>
Jul 26 17:04:38 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:04:38 user nova-compute[70594]: </disk>
Jul 26 17:04:38 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c26099-0065-409c-a06d-47979e92ef71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:04:38 user nova-compute[70594]: No targets found.
Jul 26 17:04:38 user nova-compute[70594]: iSNS:
Jul 26 17:04:38 user nova-compute[70594]: No targets found.
Jul 26 17:04:38 user nova-compute[70594]: STATIC:
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: FIRMWARE:
Jul 26 17:04:38 user nova-compute[70594]: No targets found.
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:04:38 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:04:38 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f1192c-016f-4d7d-9b76-95d1a8fec8e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f271c86551a0731a423bd2de66b694a74cfa3cd --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d9819-e22f-4ca7-b6a8-7360985b0f0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910677d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Successfully detached device vdb from instance 3f5841c2-e400-48d9-92dd-d776150c7849 from the persistent domain config.
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f5841c2-e400-48d9-92dd-d776150c7849 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:04:38 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:38 user nova-compute[70594]:   <source dev="/dev/sdb"/>
Jul 26 17:04:38 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:04:38 user nova-compute[70594]:   <serial>55bfcd51-531a-48a7-9686-8253637a4d81</serial>
Jul 26 17:04:38 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:04:38 user nova-compute[70594]: </disk>
Jul 26 17:04:38 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cfbf28-2001-4563-988c-9a61a91c7cf1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[310fd7b7-845c-47e2-b733-ed103f8d8287]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a282bb7b-a8c4-4e5e-a90a-ccca5c9d8a23]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Cannot resize image /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'migration_context' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-176363728',display_name='tempest-TestMinimumBasicScenario-server-176363728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-176363728',id=17,image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGke9iGOmvPqEKSh8QBz1Y0ruHXz1mdEoX5DAbsPsnYZuvHXRd09xN4lqJBepSsaJis60tn6XsdQ5erG81wBPM++LllZP3o1etQSYkKxJFvxlgTcLjIpEDXYCKw7/29ccQ==',key_name='tempest-TestMinimumBasicScenario-1758624021',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-b7tjwa5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:34Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=76a02a97-4400-44d2-8655-89fc12f69682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf40ec4be-97, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf40ec4be-97, col_values=(('external_ids', {'iface-id': 'f40ec4be-97e7-4bdf-a1aa-0be24286854b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:78:e9', 'vm-uuid': '76a02a97-4400-44d2-8655-89fc12f69682'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.077s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a07901-a99d-43b4-a8b4-a31b56bcd861]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:04:38 user nova-compute[70594]: INFO os_vif [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97')
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9aebe3-acd6-42e4-9fab-01a63e49aef4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.280s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a69be3f-84f6-4c3f-a943-1b68929fa220]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260]
Jul 26 17:04:38 user nova-compute[70594]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391078.779298, 3f5841c2-e400-48d9-92dd-d776150c7849 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f877c5-d8c4-4d5d-bb2b-7278b4646866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b4dc96-a8b5-4b77-861f-abfc3489414b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.659s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] <== disconnect_volume: return (661ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Successfully detached device vdb from instance 3f5841c2-e400-48d9-92dd-d776150c7849 from the live domain config.
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQKZyFTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:38 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1edc0-0756-4c13-acd9-67ec5e09d022]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:04:38 user nova-compute[70594]: No targets found.
Jul 26 17:04:38 user nova-compute[70594]: iSNS:
Jul 26 17:04:38 user nova-compute[70594]: No targets found.
Jul 26 17:04:38 user nova-compute[70594]: STATIC:
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:04:38 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:04:38 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:04:38 user nova-compute[70594]: FIRMWARE:
Jul 26 17:04:38 user nova-compute[70594]: No targets found.
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:04:38 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:04:38 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b57fa8-f96d-47a3-aab4-df8d86a62577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[809c2f8b-7ab6-4481-afd4-a09a47d782d8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:38 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:38 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5918190e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81'): ({'sdb'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Removing single pathed devices sdb {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bd1cf2-7ba2-4ed4-a448-46adba9a82c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2c4ac-474c-45f6-817a-e1234653c463]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Flushing IO for device /dev/sdb {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:04:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:39 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Deleted allocations for instance a94a2105-0e19-4d03-bea8-f9e44b6d7f79
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cf89d7-8164-4550-bfc8-84b10387bf34]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e0753a-0e30-4aa1-a579-0cec87787b47]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:39 user nova-compute[70594]: WARNING nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state deleted and task_state None.
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-unplugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-unplugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:39 user nova-compute[70594]: WARNING nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-unplugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state deleted and task_state None.
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Acquiring lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] No waiting events found dispatching network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:39 user nova-compute[70594]: WARNING nova.compute.manager [req-8511c4cc-49e5-400c-a992-6c7d94a046b2 req-658e6c9f-78b0-4f78-a6ab-ad02c11021c1 service nova] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Received unexpected event network-vif-plugged-61bf6da5-c2af-40e5-85bb-d0d1154cc4a5 for instance with vm_state deleted and task_state None.
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.055s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac862593-bf79-4859-8ff9-4ba75b070734]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6eef086e-6840-4762-b6d7-0c679d985bb0 tempest-VolumesAdminNegativeTest-2053670578 tempest-VolumesAdminNegativeTest-2053670578-project-member] Lock "a94a2105-0e19-4d03-bea8-f9e44b6d7f79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.085s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd7d1f-fa82-4c7f-9bac-7366562a28ad]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260]
Jul 26 17:04:39 user nova-compute[70594]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55bfcd51-531a-48a7-9686-8253637a4d81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8505ec49-4d5f-4a36-b9fc-c753ee1b87e0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] <== disconnect_volume: return (397ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'flavor' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e6fdc5c6-0f48-4ba7-951e-575dcf9fa398 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.376s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "interface-f2b78e55-2422-4aa4-9cc7-cec7a964d901-41f246a2-150f-4ead-98ce-b3de2bb60dc2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "interface-f2b78e55-2422-4aa4-9cc7-cec7a964d901-41f246a2-150f-4ead-98ce-b3de2bb60dc2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'flavor' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:f1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap41f246a2-15"/></interface> {{(pid=70594) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:f1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap41f246a2-15"/></interface> {{(pid=70594) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Attempting to detach device tap41f246a2-15 from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] detach device xml: <interface type="ethernet">
Jul 26 17:04:40 user nova-compute[70594]:   <mac address="fa:16:3e:5c:f1:3a"/>
Jul 26 17:04:40 user nova-compute[70594]:   <model type="virtio"/>
Jul 26 17:04:40 user nova-compute[70594]:   <mtu size="1442"/>
Jul 26 17:04:40 user nova-compute[70594]:   <target dev="tap41f246a2-15"/>
Jul 26 17:04:40 user nova-compute[70594]: </interface>
Jul 26 17:04:40 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:f1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap41f246a2-15"/></interface> {{(pid=70594) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5c:f1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap41f246a2-15"/></interface>not found in domain: <domain type='kvm' id='21'>
Jul 26 17:04:40 user nova-compute[70594]:   <name>instance-00000012</name>
Jul 26 17:04:40 user nova-compute[70594]:   <uuid>f2b78e55-2422-4aa4-9cc7-cec7a964d901</uuid>
Jul 26 17:04:40 user nova-compute[70594]:   <metadata>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:40 user nova-compute[70594]:   <nova:package version="0.0.0"/>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:name>tempest-device-tagging-server-1535981382</nova:name>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:creationTime>2023-07-26 17:04:22</nova:creationTime>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:flavor name="m1.tiny">
Jul 26 17:04:40 user nova-compute[70594]:     <nova:memory>512</nova:memory>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:disk>1</nova:disk>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:swap>0</nova:swap>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:flavor>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:owner>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:user uuid="472502ad99de4e669f2adb09afefe2d4">tempest-TaggedAttachmentsTest-15597414-project-member</nova:user>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:project uuid="ae4c76df80df42b0b4744e11d2f61b04">tempest-TaggedAttachmentsTest-15597414</nova:project>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:owner>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:ports>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:port uuid="63fbb581-4956-4207-be9e-689d6b22104d">
Jul 26 17:04:40 user nova-compute[70594]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:04:40 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:port uuid="41f246a2-150f-4ead-98ce-b3de2bb60dc2">
Jul 26 17:04:40 user nova-compute[70594]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Jul 26 17:04:40 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:ports>
Jul 26 17:04:40 user nova-compute[70594]: </nova:instance>
Jul 26 17:04:40 user nova-compute[70594]:   </metadata>
Jul 26 17:04:40 user nova-compute[70594]:   <memory unit='KiB'>524288</memory>
Jul 26 17:04:40 user nova-compute[70594]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 26 17:04:40 user nova-compute[70594]:   <vcpu placement='static'>1</vcpu>
Jul 26 17:04:40 user nova-compute[70594]:   <resource>
Jul 26 17:04:40 user nova-compute[70594]:     <partition>/machine</partition>
Jul 26 17:04:40 user nova-compute[70594]:   </resource>
Jul 26 17:04:40 user nova-compute[70594]:   <sysinfo type='smbios'>
Jul 26 17:04:40 user nova-compute[70594]:     <system>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='product'>OpenStack Nova</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='version'>0.0.0</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='serial'>f2b78e55-2422-4aa4-9cc7-cec7a964d901</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='uuid'>f2b78e55-2422-4aa4-9cc7-cec7a964d901</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='family'>Virtual Machine</entry>
Jul 26 17:04:40 user nova-compute[70594]:     </system>
Jul 26 17:04:40 user nova-compute[70594]:   </sysinfo>
Jul 26 17:04:40 user nova-compute[70594]:   <os>
Jul 26 17:04:40 user nova-compute[70594]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 26 17:04:40 user nova-compute[70594]:     <boot dev='hd'/>
Jul 26 17:04:40 user nova-compute[70594]:     <smbios mode='sysinfo'/>
Jul 26 17:04:40 user nova-compute[70594]:   </os>
Jul 26 17:04:40 user nova-compute[70594]:   <features>
Jul 26 17:04:40 user nova-compute[70594]:     <acpi/>
Jul 26 17:04:40 user nova-compute[70594]:     <apic/>
Jul 26 17:04:40 user nova-compute[70594]:     <vmcoreinfo state='on'/>
Jul 26 17:04:40 user nova-compute[70594]:   </features>
Jul 26 17:04:40 user nova-compute[70594]:   <cpu mode='custom' match='exact' check='full'>
Jul 26 17:04:40 user nova-compute[70594]:     <model fallback='forbid'>Nehalem</model>
Jul 26 17:04:40 user nova-compute[70594]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 26 17:04:40 user nova-compute[70594]:     <feature policy='require' name='vme'/>
Jul 26 17:04:40 user nova-compute[70594]:     <feature policy='require' name='x2apic'/>
Jul 26 17:04:40 user nova-compute[70594]:     <feature policy='require' name='hypervisor'/>
Jul 26 17:04:40 user nova-compute[70594]:   </cpu>
Jul 26 17:04:40 user nova-compute[70594]:   <clock offset='utc'>
Jul 26 17:04:40 user nova-compute[70594]:     <timer name='pit' tickpolicy='delay'/>
Jul 26 17:04:40 user nova-compute[70594]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 26 17:04:40 user nova-compute[70594]:     <timer name='hpet' present='no'/>
Jul 26 17:04:40 user nova-compute[70594]:   </clock>
Jul 26 17:04:40 user nova-compute[70594]:   <on_poweroff>destroy</on_poweroff>
Jul 26 17:04:40 user nova-compute[70594]:   <on_reboot>restart</on_reboot>
Jul 26 17:04:40 user nova-compute[70594]:   <on_crash>destroy</on_crash>
Jul 26 17:04:40 user nova-compute[70594]:   <devices>
Jul 26 17:04:40 user nova-compute[70594]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 26 17:04:40 user nova-compute[70594]:     <disk type='file' device='disk'>
Jul 26 17:04:40 user nova-compute[70594]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 26 17:04:40 user nova-compute[70594]:       <source file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk' index='2'/>
Jul 26 17:04:40 user nova-compute[70594]:       <backingStore type='file' index='3'>
Jul 26 17:04:40 user nova-compute[70594]:         <format type='raw'/>
Jul 26 17:04:40 user nova-compute[70594]:         <source file='/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b'/>
Jul 26 17:04:40 user nova-compute[70594]:         <backingStore/>
Jul 26 17:04:40 user nova-compute[70594]:       </backingStore>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='vda' bus='virtio'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='virtio-disk0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </disk>
Jul 26 17:04:40 user nova-compute[70594]:     <disk type='file' device='cdrom'>
Jul 26 17:04:40 user nova-compute[70594]:       <driver name='qemu' type='raw' cache='none'/>
Jul 26 17:04:40 user nova-compute[70594]:       <source file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.config' index='1'/>
Jul 26 17:04:40 user nova-compute[70594]:       <backingStore/>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='hda' bus='ide'/>
Jul 26 17:04:40 user nova-compute[70594]:       <readonly/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='ide0-0-0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </disk>
Jul 26 17:04:40 user nova-compute[70594]:     <controller type='usb' index='0' model='none'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='usb'/>
Jul 26 17:04:40 user nova-compute[70594]:     </controller>
Jul 26 17:04:40 user nova-compute[70594]:     <controller type='pci' index='0' model='pci-root'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='pci.0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </controller>
Jul 26 17:04:40 user nova-compute[70594]:     <controller type='ide' index='0'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='ide'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 26 17:04:40 user nova-compute[70594]:     </controller>
Jul 26 17:04:40 user nova-compute[70594]:     <interface type='ethernet'>
Jul 26 17:04:40 user nova-compute[70594]:       <mac address='fa:16:3e:85:13:20'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='tap63fbb581-49'/>
Jul 26 17:04:40 user nova-compute[70594]:       <model type='virtio'/>
Jul 26 17:04:40 user nova-compute[70594]:       <mtu size='1442'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='net0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </interface>
Jul 26 17:04:40 user nova-compute[70594]:     <interface type='ethernet'>
Jul 26 17:04:40 user nova-compute[70594]:       <mac address='fa:16:3e:5c:f1:3a'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='tap41f246a2-15'/>
Jul 26 17:04:40 user nova-compute[70594]:       <model type='virtio'/>
Jul 26 17:04:40 user nova-compute[70594]:       <mtu size='1442'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='net1'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </interface>
Jul 26 17:04:40 user nova-compute[70594]:     <serial type='pty'>
Jul 26 17:04:40 user nova-compute[70594]:       <source path='/dev/pts/7'/>
Jul 26 17:04:40 user nova-compute[70594]:       <log file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/console.log' append='off'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target type='isa-serial' port='0'>
Jul 26 17:04:40 user nova-compute[70594]:         <model name='isa-serial'/>
Jul 26 17:04:40 user nova-compute[70594]:       </target>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='serial0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </serial>
Jul 26 17:04:40 user nova-compute[70594]:     <console type='pty' tty='/dev/pts/7'>
Jul 26 17:04:40 user nova-compute[70594]:       <source path='/dev/pts/7'/>
Jul 26 17:04:40 user nova-compute[70594]:       <log file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/console.log' append='off'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target type='serial' port='0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='serial0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </console>
Jul 26 17:04:40 user nova-compute[70594]:     <input type='mouse' bus='ps2'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='input0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </input>
Jul 26 17:04:40 user nova-compute[70594]:     <input type='keyboard' bus='ps2'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='input1'/>
Jul 26 17:04:40 user nova-compute[70594]:     </input>
Jul 26 17:04:40 user nova-compute[70594]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 26 17:04:40 user nova-compute[70594]:       <listen type='address' address='0.0.0.0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </graphics>
Jul 26 17:04:40 user nova-compute[70594]:     <audio id='1' type='none'/>
Jul 26 17:04:40 user nova-compute[70594]:     <video>
Jul 26 17:04:40 user nova-compute[70594]:       <model type='virtio' heads='1' primary='yes'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='video0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </video>
Jul 26 17:04:40 user nova-compute[70594]:     <memballoon model='virtio'>
Jul 26 17:04:40 user nova-compute[70594]:       <stats period='10'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='balloon0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </memballoon>
Jul 26 17:04:40 user nova-compute[70594]:     <rng model='virtio'>
Jul 26 17:04:40 user nova-compute[70594]:       <backend model='random'>/dev/urandom</backend>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='rng0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </rng>
Jul 26 17:04:40 user nova-compute[70594]:   </devices>
Jul 26 17:04:40 user nova-compute[70594]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 26 17:04:40 user nova-compute[70594]:     <label>libvirt-f2b78e55-2422-4aa4-9cc7-cec7a964d901</label>
Jul 26 17:04:40 user nova-compute[70594]:     <imagelabel>libvirt-f2b78e55-2422-4aa4-9cc7-cec7a964d901</imagelabel>
Jul 26 17:04:40 user nova-compute[70594]:   </seclabel>
Jul 26 17:04:40 user nova-compute[70594]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 26 17:04:40 user nova-compute[70594]:     <label>+64055:+108</label>
Jul 26 17:04:40 user nova-compute[70594]:     <imagelabel>+64055:+108</imagelabel>
Jul 26 17:04:40 user nova-compute[70594]:   </seclabel>
Jul 26 17:04:40 user nova-compute[70594]: </domain>
Jul 26 17:04:40 user nova-compute[70594]:  {{(pid=70594) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 26 17:04:40 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully detached device tap41f246a2-15 from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the persistent domain config.
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] (1/8): Attempting to detach device tap41f246a2-15 with device alias net1 from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] detach device xml: <interface type="ethernet">
Jul 26 17:04:40 user nova-compute[70594]:   <mac address="fa:16:3e:5c:f1:3a"/>
Jul 26 17:04:40 user nova-compute[70594]:   <model type="virtio"/>
Jul 26 17:04:40 user nova-compute[70594]:   <mtu size="1442"/>
Jul 26 17:04:40 user nova-compute[70594]:   <target dev="tap41f246a2-15"/>
Jul 26 17:04:40 user nova-compute[70594]: </interface>
Jul 26 17:04:40 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'flavor' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391080.492779, f2b78e55-2422-4aa4-9cc7-cec7a964d901 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Start waiting for the detach event from libvirt for device tap41f246a2-15 with device alias net1 for instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5c:f1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap41f246a2-15"/></interface> {{(pid=70594) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5c:f1:3a"/><model type="virtio"/><mtu size="1442"/><target dev="tap41f246a2-15"/></interface>not found in domain: <domain type='kvm' id='21'>
Jul 26 17:04:40 user nova-compute[70594]:   <name>instance-00000012</name>
Jul 26 17:04:40 user nova-compute[70594]:   <uuid>f2b78e55-2422-4aa4-9cc7-cec7a964d901</uuid>
Jul 26 17:04:40 user nova-compute[70594]:   <metadata>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:40 user nova-compute[70594]:   <nova:package version="0.0.0"/>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:name>tempest-device-tagging-server-1535981382</nova:name>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:creationTime>2023-07-26 17:04:22</nova:creationTime>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:flavor name="m1.tiny">
Jul 26 17:04:40 user nova-compute[70594]:     <nova:memory>512</nova:memory>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:disk>1</nova:disk>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:swap>0</nova:swap>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:flavor>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:owner>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:user uuid="472502ad99de4e669f2adb09afefe2d4">tempest-TaggedAttachmentsTest-15597414-project-member</nova:user>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:project uuid="ae4c76df80df42b0b4744e11d2f61b04">tempest-TaggedAttachmentsTest-15597414</nova:project>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:owner>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:ports>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:port uuid="63fbb581-4956-4207-be9e-689d6b22104d">
Jul 26 17:04:40 user nova-compute[70594]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:04:40 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:port uuid="41f246a2-150f-4ead-98ce-b3de2bb60dc2">
Jul 26 17:04:40 user nova-compute[70594]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Jul 26 17:04:40 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:ports>
Jul 26 17:04:40 user nova-compute[70594]: </nova:instance>
Jul 26 17:04:40 user nova-compute[70594]:   </metadata>
Jul 26 17:04:40 user nova-compute[70594]:   <memory unit='KiB'>524288</memory>
Jul 26 17:04:40 user nova-compute[70594]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 26 17:04:40 user nova-compute[70594]:   <vcpu placement='static'>1</vcpu>
Jul 26 17:04:40 user nova-compute[70594]:   <resource>
Jul 26 17:04:40 user nova-compute[70594]:     <partition>/machine</partition>
Jul 26 17:04:40 user nova-compute[70594]:   </resource>
Jul 26 17:04:40 user nova-compute[70594]:   <sysinfo type='smbios'>
Jul 26 17:04:40 user nova-compute[70594]:     <system>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='product'>OpenStack Nova</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='version'>0.0.0</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='serial'>f2b78e55-2422-4aa4-9cc7-cec7a964d901</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='uuid'>f2b78e55-2422-4aa4-9cc7-cec7a964d901</entry>
Jul 26 17:04:40 user nova-compute[70594]:       <entry name='family'>Virtual Machine</entry>
Jul 26 17:04:40 user nova-compute[70594]:     </system>
Jul 26 17:04:40 user nova-compute[70594]:   </sysinfo>
Jul 26 17:04:40 user nova-compute[70594]:   <os>
Jul 26 17:04:40 user nova-compute[70594]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 26 17:04:40 user nova-compute[70594]:     <boot dev='hd'/>
Jul 26 17:04:40 user nova-compute[70594]:     <smbios mode='sysinfo'/>
Jul 26 17:04:40 user nova-compute[70594]:   </os>
Jul 26 17:04:40 user nova-compute[70594]:   <features>
Jul 26 17:04:40 user nova-compute[70594]:     <acpi/>
Jul 26 17:04:40 user nova-compute[70594]:     <apic/>
Jul 26 17:04:40 user nova-compute[70594]:     <vmcoreinfo state='on'/>
Jul 26 17:04:40 user nova-compute[70594]:   </features>
Jul 26 17:04:40 user nova-compute[70594]:   <cpu mode='custom' match='exact' check='full'>
Jul 26 17:04:40 user nova-compute[70594]:     <model fallback='forbid'>Nehalem</model>
Jul 26 17:04:40 user nova-compute[70594]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 26 17:04:40 user nova-compute[70594]:     <feature policy='require' name='vme'/>
Jul 26 17:04:40 user nova-compute[70594]:     <feature policy='require' name='x2apic'/>
Jul 26 17:04:40 user nova-compute[70594]:     <feature policy='require' name='hypervisor'/>
Jul 26 17:04:40 user nova-compute[70594]:   </cpu>
Jul 26 17:04:40 user nova-compute[70594]:   <clock offset='utc'>
Jul 26 17:04:40 user nova-compute[70594]:     <timer name='pit' tickpolicy='delay'/>
Jul 26 17:04:40 user nova-compute[70594]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 26 17:04:40 user nova-compute[70594]:     <timer name='hpet' present='no'/>
Jul 26 17:04:40 user nova-compute[70594]:   </clock>
Jul 26 17:04:40 user nova-compute[70594]:   <on_poweroff>destroy</on_poweroff>
Jul 26 17:04:40 user nova-compute[70594]:   <on_reboot>restart</on_reboot>
Jul 26 17:04:40 user nova-compute[70594]:   <on_crash>destroy</on_crash>
Jul 26 17:04:40 user nova-compute[70594]:   <devices>
Jul 26 17:04:40 user nova-compute[70594]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 26 17:04:40 user nova-compute[70594]:     <disk type='file' device='disk'>
Jul 26 17:04:40 user nova-compute[70594]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 26 17:04:40 user nova-compute[70594]:       <source file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk' index='2'/>
Jul 26 17:04:40 user nova-compute[70594]:       <backingStore type='file' index='3'>
Jul 26 17:04:40 user nova-compute[70594]:         <format type='raw'/>
Jul 26 17:04:40 user nova-compute[70594]:         <source file='/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b'/>
Jul 26 17:04:40 user nova-compute[70594]:         <backingStore/>
Jul 26 17:04:40 user nova-compute[70594]:       </backingStore>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='vda' bus='virtio'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='virtio-disk0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </disk>
Jul 26 17:04:40 user nova-compute[70594]:     <disk type='file' device='cdrom'>
Jul 26 17:04:40 user nova-compute[70594]:       <driver name='qemu' type='raw' cache='none'/>
Jul 26 17:04:40 user nova-compute[70594]:       <source file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk.config' index='1'/>
Jul 26 17:04:40 user nova-compute[70594]:       <backingStore/>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='hda' bus='ide'/>
Jul 26 17:04:40 user nova-compute[70594]:       <readonly/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='ide0-0-0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </disk>
Jul 26 17:04:40 user nova-compute[70594]:     <controller type='usb' index='0' model='none'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='usb'/>
Jul 26 17:04:40 user nova-compute[70594]:     </controller>
Jul 26 17:04:40 user nova-compute[70594]:     <controller type='pci' index='0' model='pci-root'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='pci.0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </controller>
Jul 26 17:04:40 user nova-compute[70594]:     <controller type='ide' index='0'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='ide'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 26 17:04:40 user nova-compute[70594]:     </controller>
Jul 26 17:04:40 user nova-compute[70594]:     <interface type='ethernet'>
Jul 26 17:04:40 user nova-compute[70594]:       <mac address='fa:16:3e:85:13:20'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target dev='tap63fbb581-49'/>
Jul 26 17:04:40 user nova-compute[70594]:       <model type='virtio'/>
Jul 26 17:04:40 user nova-compute[70594]:       <mtu size='1442'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='net0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </interface>
Jul 26 17:04:40 user nova-compute[70594]:     <serial type='pty'>
Jul 26 17:04:40 user nova-compute[70594]:       <source path='/dev/pts/7'/>
Jul 26 17:04:40 user nova-compute[70594]:       <log file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/console.log' append='off'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target type='isa-serial' port='0'>
Jul 26 17:04:40 user nova-compute[70594]:         <model name='isa-serial'/>
Jul 26 17:04:40 user nova-compute[70594]:       </target>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='serial0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </serial>
Jul 26 17:04:40 user nova-compute[70594]:     <console type='pty' tty='/dev/pts/7'>
Jul 26 17:04:40 user nova-compute[70594]:       <source path='/dev/pts/7'/>
Jul 26 17:04:40 user nova-compute[70594]:       <log file='/opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/console.log' append='off'/>
Jul 26 17:04:40 user nova-compute[70594]:       <target type='serial' port='0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='serial0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </console>
Jul 26 17:04:40 user nova-compute[70594]:     <input type='mouse' bus='ps2'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='input0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </input>
Jul 26 17:04:40 user nova-compute[70594]:     <input type='keyboard' bus='ps2'>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='input1'/>
Jul 26 17:04:40 user nova-compute[70594]:     </input>
Jul 26 17:04:40 user nova-compute[70594]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 26 17:04:40 user nova-compute[70594]:       <listen type='address' address='0.0.0.0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </graphics>
Jul 26 17:04:40 user nova-compute[70594]:     <audio id='1' type='none'/>
Jul 26 17:04:40 user nova-compute[70594]:     <video>
Jul 26 17:04:40 user nova-compute[70594]:       <model type='virtio' heads='1' primary='yes'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='video0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </video>
Jul 26 17:04:40 user nova-compute[70594]:     <memballoon model='virtio'>
Jul 26 17:04:40 user nova-compute[70594]:       <stats period='10'/>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='balloon0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </memballoon>
Jul 26 17:04:40 user nova-compute[70594]:     <rng model='virtio'>
Jul 26 17:04:40 user nova-compute[70594]:       <backend model='random'>/dev/urandom</backend>
Jul 26 17:04:40 user nova-compute[70594]:       <alias name='rng0'/>
Jul 26 17:04:40 user nova-compute[70594]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 26 17:04:40 user nova-compute[70594]:     </rng>
Jul 26 17:04:40 user nova-compute[70594]:   </devices>
Jul 26 17:04:40 user nova-compute[70594]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 26 17:04:40 user nova-compute[70594]:     <label>libvirt-f2b78e55-2422-4aa4-9cc7-cec7a964d901</label>
Jul 26 17:04:40 user nova-compute[70594]:     <imagelabel>libvirt-f2b78e55-2422-4aa4-9cc7-cec7a964d901</imagelabel>
Jul 26 17:04:40 user nova-compute[70594]:   </seclabel>
Jul 26 17:04:40 user nova-compute[70594]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 26 17:04:40 user nova-compute[70594]:     <label>+64055:+108</label>
Jul 26 17:04:40 user nova-compute[70594]:     <imagelabel>+64055:+108</imagelabel>
Jul 26 17:04:40 user nova-compute[70594]:   </seclabel>
Jul 26 17:04:40 user nova-compute[70594]: </domain>
Jul 26 17:04:40 user nova-compute[70594]:  {{(pid=70594) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 26 17:04:40 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully detached device tap41f246a2-15 from instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 from the live domain config.
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "address": "fa:16:3e:5c:f1:3a", "network": {"id": "c316ab37-90d1-4902-99db-a6fad5d17ebb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-443984999", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f246a2-15", "ovs_interfaceid": "41f246a2-150f-4ead-98ce-b3de2bb60dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG os_vif [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41f246a2-15, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6bacf19d-ad15-459f-9982-19310cc705f1 tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.706s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:40 user nova-compute[70594]: INFO os_vif [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:3a,bridge_name='br-int',has_traffic_filtering=True,id=41f246a2-150f-4ead-98ce-b3de2bb60dc2,network=Network(c316ab37-90d1-4902-99db-a6fad5d17ebb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f246a2-15')
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:40 user nova-compute[70594]:   <nova:package version="0.0.0"/>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:name>tempest-device-tagging-server-1535981382</nova:name>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:creationTime>2023-07-26 17:04:40</nova:creationTime>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:flavor name="m1.tiny">
Jul 26 17:04:40 user nova-compute[70594]:     <nova:memory>512</nova:memory>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:disk>1</nova:disk>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:swap>0</nova:swap>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:flavor>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:owner>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:user uuid="472502ad99de4e669f2adb09afefe2d4">tempest-TaggedAttachmentsTest-15597414-project-member</nova:user>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:project uuid="ae4c76df80df42b0b4744e11d2f61b04">tempest-TaggedAttachmentsTest-15597414</nova:project>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:owner>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:40 user nova-compute[70594]:   <nova:ports>
Jul 26 17:04:40 user nova-compute[70594]:     <nova:port uuid="63fbb581-4956-4207-be9e-689d6b22104d">
Jul 26 17:04:40 user nova-compute[70594]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:04:40 user nova-compute[70594]:     </nova:port>
Jul 26 17:04:40 user nova-compute[70594]:   </nova:ports>
Jul 26 17:04:40 user nova-compute[70594]: </nova:instance>
Jul 26 17:04:40 user nova-compute[70594]:  {{(pid=70594) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.compute.manager [req-6acb8037-5cd1-42a4-b34e-6884e97642d0 req-dfa64017-bcf0-4920-96fa-4d3533afed1c service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-unplugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6acb8037-5cd1-42a4-b34e-6884e97642d0 req-dfa64017-bcf0-4920-96fa-4d3533afed1c service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6acb8037-5cd1-42a4-b34e-6884e97642d0 req-dfa64017-bcf0-4920-96fa-4d3533afed1c service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6acb8037-5cd1-42a4-b34e-6884e97642d0 req-dfa64017-bcf0-4920-96fa-4d3533afed1c service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG nova.compute.manager [req-6acb8037-5cd1-42a4-b34e-6884e97642d0 req-dfa64017-bcf0-4920-96fa-4d3533afed1c service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-unplugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:40 user nova-compute[70594]: WARNING nova.compute.manager [req-6acb8037-5cd1-42a4-b34e-6884e97642d0 req-dfa64017-bcf0-4920-96fa-4d3533afed1c service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-unplugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 for instance with vm_state active and task_state None.
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:41 user nova-compute[70594]: WARNING nova.compute.manager [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state active and task_state reboot_started_hard.
Jul 26 17:04:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:41 user nova-compute[70594]: WARNING nova.compute.manager [req-0f63c86d-a832-42c6-8df7-28fb6369a5f4 req-46c93e73-587c-4bfd-869a-cf5a16498441 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state active and task_state reboot_started_hard.
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquired lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:42 user nova-compute[70594]: INFO nova.network.neutron [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Port 41f246a2-150f-4ead-98ce-b3de2bb60dc2 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.network.neutron [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [{"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Releasing lock "refresh_cache-f2b78e55-2422-4aa4-9cc7-cec7a964d901" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-dda85416-09d2-4489-8f95-23b61cc0f588 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "interface-f2b78e55-2422-4aa4-9cc7-cec7a964d901-41f246a2-150f-4ead-98ce-b3de2bb60dc2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.158s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 76a02a97-4400-44d2-8655-89fc12f69682 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391082.5752761, 76a02a97-4400-44d2-8655-89fc12f69682 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:42 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] VM Resumed (Lifecycle Event)
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:04:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance rebooted successfully.
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:42 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391082.5789785, 76a02a97-4400-44d2-8655-89fc12f69682 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:42 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] VM Started (Lifecycle Event)
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fadce1d6-b152-41bf-9e48-cfa49c2b2134 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.213s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:42 user nova-compute[70594]: WARNING nova.compute.manager [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-plugged-41f246a2-150f-4ead-98ce-b3de2bb60dc2 for instance with vm_state active and task_state None.
Jul 26 17:04:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ceff28c-0570-4fff-b44a-f5db43632601 req-e6210a04-d7f6-4f43-ba4d-d219eb032022 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-deleted-41f246a2-150f-4ead-98ce-b3de2bb60dc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:04:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Creating image(s)
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Ensure instance console log exists: /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Start _get_guest_xml network_info=[{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ef02326-71b1-43ca-a53d-c2f73b049896', 'attached_at': '', 'detached_at': '', 'volume_id': '55b56260-a269-4ce7-9398-b195ced9b560', 'serial': '55b56260-a269-4ce7-9398-b195ced9b560'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '71883000-97f6-4dc4-826e-1fc403cb719f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:04:44 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:44 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:44 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:44 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:04:44 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b422c9-630b-4a7d-a087-26515b270789]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:04:44 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e77d8db-7ca5-4c44-8939-d9c0fd53fbb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560] added
Jul 26 17:04:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e77f00-fc0f-4ae9-83c5-a280e6262d23]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba10880-58a4-42bb-9f9a-14dcf3a0a21c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjVCymI {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjVCymI" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d0d22-68b9-4e5e-b5c4-97f3d9ee0000]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEjVCymI'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed9fb23-c72a-4804-bb03-8626f6f3d1e0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a964d-a881-4cd1-8b0d-3d8d4d73000a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:44 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:44 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e33faa-182e-4c09-884f-e2ef377a08d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260]
Jul 26 17:04:44 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260] successful.
Jul 26 17:04:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab9176-1b60-401d-a528-0de54fdf8e36]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a346b8-d0a5-4c4a-a1bf-11751f79cb0f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:44 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:44 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:04:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:04:44 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:04:44 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:04:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[174cf10b-64dc-4eef-b822-c5e5aaf31e4e]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:04:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26465623134303863', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465623134303863', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-252829452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-252829452',id=21,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-0zmjpmej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:29Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=8ef02326-71b1-43ca-a53d-c2f73b049896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:04:45 user nova-compute[70594]:   <uuid>8ef02326-71b1-43ca-a53d-c2f73b049896</uuid>
Jul 26 17:04:45 user nova-compute[70594]:   <name>instance-00000015</name>
Jul 26 17:04:45 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:04:45 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:04:45 user nova-compute[70594]:   <metadata>
Jul 26 17:04:45 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:04:45 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:04:45 user nova-compute[70594]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-252829452</nova:name>
Jul 26 17:04:45 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:04:44</nova:creationTime>
Jul 26 17:04:45 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:04:45 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:04:45 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:04:45 user nova-compute[70594]:       <nova:owner>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:user uuid="f6af9ec8d9d644c89ba32c10861afba2">tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member</nova:user>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:project uuid="d253357a8f7b42119a7b91385afa0e8b">tempest-ServerBootFromVolumeStableRescueTest-43751456</nova:project>
Jul 26 17:04:45 user nova-compute[70594]:       </nova:owner>
Jul 26 17:04:45 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:04:45 user nova-compute[70594]:       <nova:ports>
Jul 26 17:04:45 user nova-compute[70594]:         <nova:port uuid="62446ba5-f54c-433c-91c2-b5f430eccc3a">
Jul 26 17:04:45 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 26 17:04:45 user nova-compute[70594]:         </nova:port>
Jul 26 17:04:45 user nova-compute[70594]:       </nova:ports>
Jul 26 17:04:45 user nova-compute[70594]:     </nova:instance>
Jul 26 17:04:45 user nova-compute[70594]:   </metadata>
Jul 26 17:04:45 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:04:45 user nova-compute[70594]:     <system>
Jul 26 17:04:45 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:04:45 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:04:45 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:04:45 user nova-compute[70594]:       <entry name="serial">8ef02326-71b1-43ca-a53d-c2f73b049896</entry>
Jul 26 17:04:45 user nova-compute[70594]:       <entry name="uuid">8ef02326-71b1-43ca-a53d-c2f73b049896</entry>
Jul 26 17:04:45 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:04:45 user nova-compute[70594]:     </system>
Jul 26 17:04:45 user nova-compute[70594]:   </sysinfo>
Jul 26 17:04:45 user nova-compute[70594]:   <os>
Jul 26 17:04:45 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:04:45 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:04:45 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:04:45 user nova-compute[70594]:   </os>
Jul 26 17:04:45 user nova-compute[70594]:   <features>
Jul 26 17:04:45 user nova-compute[70594]:     <acpi/>
Jul 26 17:04:45 user nova-compute[70594]:     <apic/>
Jul 26 17:04:45 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:04:45 user nova-compute[70594]:   </features>
Jul 26 17:04:45 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:04:45 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:04:45 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:04:45 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:04:45 user nova-compute[70594]:   </clock>
Jul 26 17:04:45 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:04:45 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:04:45 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:04:45 user nova-compute[70594]:   </cpu>
Jul 26 17:04:45 user nova-compute[70594]:   <devices>
Jul 26 17:04:45 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:04:45 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:04:45 user nova-compute[70594]:       <source dev="/dev/sdb"/>
Jul 26 17:04:45 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:04:45 user nova-compute[70594]:       <serial>55b56260-a269-4ce7-9398-b195ced9b560</serial>
Jul 26 17:04:45 user nova-compute[70594]:     </disk>
Jul 26 17:04:45 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:04:45 user nova-compute[70594]:       <mac address="fa:16:3e:d4:b7:0b"/>
Jul 26 17:04:45 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:45 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:04:45 user nova-compute[70594]:       <target dev="tap62446ba5-f5"/>
Jul 26 17:04:45 user nova-compute[70594]:     </interface>
Jul 26 17:04:45 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:04:45 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/console.log" append="off"/>
Jul 26 17:04:45 user nova-compute[70594]:     </serial>
Jul 26 17:04:45 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:04:45 user nova-compute[70594]:     <video>
Jul 26 17:04:45 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:04:45 user nova-compute[70594]:     </video>
Jul 26 17:04:45 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:04:45 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:04:45 user nova-compute[70594]:     </rng>
Jul 26 17:04:45 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:04:45 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:04:45 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:04:45 user nova-compute[70594]:     </memballoon>
Jul 26 17:04:45 user nova-compute[70594]:   </devices>
Jul 26 17:04:45 user nova-compute[70594]: </domain>
Jul 26 17:04:45 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-252829452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-252829452',id=21,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-0zmjpmej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:29Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=8ef02326-71b1-43ca-a53d-c2f73b049896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG os_vif [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62446ba5-f5, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62446ba5-f5, col_values=(('external_ids', {'iface-id': '62446ba5-f54c-433c-91c2-b5f430eccc3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:b7:0b', 'vm-uuid': '8ef02326-71b1-43ca-a53d-c2f73b049896'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:45 user nova-compute[70594]: INFO os_vif [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5')
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:04:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No VIF found with MAC fa:16:3e:d4:b7:0b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-changed-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Refreshing instance network info cache due to event network-changed-402aafc0-cc42-483f-8bea-81d9184e537e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] Acquiring lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] Acquired lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Refreshing network info cache for port 402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Updated VIF entry in instance network info cache for port 402aafc0-cc42-483f-8bea-81d9184e537e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Updating instance_info_cache with network_info: [{"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-479db196-d74a-4ac2-9d1e-cabd7cd47721 req-242097d2-9a01-4233-a96c-2371c09711cf service nova] Releasing lock "refresh_cache-60c4b302-f745-4b4c-8462-258338fcb0fe" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:47 user nova-compute[70594]: INFO nova.compute.manager [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Unrescuing
Jul 26 17:04:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cbc7bbdf-5bc8-4dbf-9f36-34be1cab3967 req-68fc3ed0-e925-45a5-9d22-351ef966f8d5 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cbc7bbdf-5bc8-4dbf-9f36-34be1cab3967 req-68fc3ed0-e925-45a5-9d22-351ef966f8d5 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cbc7bbdf-5bc8-4dbf-9f36-34be1cab3967 req-68fc3ed0-e925-45a5-9d22-351ef966f8d5 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cbc7bbdf-5bc8-4dbf-9f36-34be1cab3967 req-68fc3ed0-e925-45a5-9d22-351ef966f8d5 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cbc7bbdf-5bc8-4dbf-9f36-34be1cab3967 req-68fc3ed0-e925-45a5-9d22-351ef966f8d5 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:47 user nova-compute[70594]: WARNING nova.compute.manager [req-cbc7bbdf-5bc8-4dbf-9f36-34be1cab3967 req-68fc3ed0-e925-45a5-9d22-351ef966f8d5 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state building and task_state spawning.
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'flavor' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-0ee77962-68b9-4314-9558-0e437adeb375 req-d3032424-b293-4603-a9f2-c8d5a0ece5cf service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0ee77962-68b9-4314-9558-0e437adeb375 req-d3032424-b293-4603-a9f2-c8d5a0ece5cf service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0ee77962-68b9-4314-9558-0e437adeb375 req-d3032424-b293-4603-a9f2-c8d5a0ece5cf service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0ee77962-68b9-4314-9558-0e437adeb375 req-d3032424-b293-4603-a9f2-c8d5a0ece5cf service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-0ee77962-68b9-4314-9558-0e437adeb375 req-d3032424-b293-4603-a9f2-c8d5a0ece5cf service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:48 user nova-compute[70594]: WARNING nova.compute.manager [req-0ee77962-68b9-4314-9558-0e437adeb375 req-d3032424-b293-4603-a9f2-c8d5a0ece5cf service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance destroyed successfully.
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-e5388727-5bb0-4449-ac93-e3594ab7ad53 req-3a65f831-e775-4ae7-9a89-d1fdc3a775ff service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5388727-5bb0-4449-ac93-e3594ab7ad53 req-3a65f831-e775-4ae7-9a89-d1fdc3a775ff service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5388727-5bb0-4449-ac93-e3594ab7ad53 req-3a65f831-e775-4ae7-9a89-d1fdc3a775ff service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e5388727-5bb0-4449-ac93-e3594ab7ad53 req-3a65f831-e775-4ae7-9a89-d1fdc3a775ff service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-e5388727-5bb0-4449-ac93-e3594ab7ad53 req-3a65f831-e775-4ae7-9a89-d1fdc3a775ff service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:49 user nova-compute[70594]: WARNING nova.compute.manager [req-e5388727-5bb0-4449-ac93-e3594ab7ad53 req-3a65f831-e775-4ae7-9a89-d1fdc3a775ff service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state building and task_state spawning.
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391089.75761, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Resumed (Lifecycle Event)
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance spawned successfully.
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391089.7577467, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Started (Lifecycle Event)
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:04:49 user nova-compute[70594]: INFO nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 26 17:04:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:50 user nova-compute[70594]: INFO nova.compute.manager [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Took 22.40 seconds to build instance.
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9330d433-108f-4852-a72d-03100d60228e tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.499s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:50 user nova-compute[70594]: INFO nova.compute.manager [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Terminating instance
Jul 26 17:04:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-11e728c7-4f80-49ef-9df5-9bd47108c811 req-b60f60dd-db26-4105-8199-a2ea53e3833f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-11e728c7-4f80-49ef-9df5-9bd47108c811 req-b60f60dd-db26-4105-8199-a2ea53e3833f service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-11e728c7-4f80-49ef-9df5-9bd47108c811 req-b60f60dd-db26-4105-8199-a2ea53e3833f service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-11e728c7-4f80-49ef-9df5-9bd47108c811 req-b60f60dd-db26-4105-8199-a2ea53e3833f service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-11e728c7-4f80-49ef-9df5-9bd47108c811 req-b60f60dd-db26-4105-8199-a2ea53e3833f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:50 user nova-compute[70594]: WARNING nova.compute.manager [req-11e728c7-4f80-49ef-9df5-9bd47108c811 req-b60f60dd-db26-4105-8199-a2ea53e3833f service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:50 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391075.9283059, a94a2105-0e19-4d03-bea8-f9e44b6d7f79 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:50 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] VM Stopped (Lifecycle Event)
Jul 26 17:04:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e594c970-c699-474c-a0ce-9fc2c7179e5c None None] [instance: a94a2105-0e19-4d03-bea8-f9e44b6d7f79] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Instance destroyed successfully.
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'resources' on Instance uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid d51f1e40-acab-40c5-814d-ca5022cf04c7 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid ae56085e-6a66-494f-9ec0-2397ec7eb4b0 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 60c4b302-f745-4b4c-8462-258338fcb0fe {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: INFO nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T16:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-932025414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-932025414',id=7,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/w6WOcQhiqS/3FyZmC4OK2c81YiTIVV6Ahj8uL8bOuqIQ2MwKz77Pp39C0RXj21WTnTmR/EVR7Hm439n7sCQbqXBnQ1TWgTDTl3x8OEKtFMjNb+lQxSaHpnqgo64OmWQ==',key_name='tempest-keypair-1077150454',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-2sdwm5fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=ae56085e-6a66-494f-9ec0-2397ec7eb4b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "58242289-8f80-4512-8cdb-0847afd81d42", "address": "fa:16:3e:f0:9b:cd", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58242289-8f", "ovs_interfaceid": "58242289-8f80-4512-8cdb-0847afd81d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG os_vif [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58242289-8f, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:04:51 user nova-compute[70594]: INFO os_vif [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:9b:cd,bridge_name='br-int',has_traffic_filtering=True,id=58242289-8f80-4512-8cdb-0847afd81d42,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58242289-8f')
Jul 26 17:04:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Deleting instance files /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0_del
Jul 26 17:04:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Deletion of /opt/stack/data/nova/instances/ae56085e-6a66-494f-9ec0-2397ec7eb4b0_del complete
Jul 26 17:04:51 user nova-compute[70594]: WARNING oslo_messaging._drivers.amqpdriver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-unplugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-unplugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-unplugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] Acquiring lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] No waiting events found dispatching network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:51 user nova-compute[70594]: WARNING nova.compute.manager [req-ec942efb-9493-4bb4-8ce0-b84c699a0d66 req-95e91d03-71a5-4170-b28d-fc5cdc8a5fb7 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received unexpected event network-vif-plugged-58242289-8f80-4512-8cdb-0847afd81d42 for instance with vm_state active and task_state deleting.
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.187s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.181s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.196s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:51 user nova-compute[70594]: INFO nova.compute.manager [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 26 17:04:51 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:04:51 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:52 user nova-compute[70594]: WARNING nova.compute.manager [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:04:52 user nova-compute[70594]: WARNING nova.compute.manager [req-a805cba9-7ff4-4833-803e-1c4981b8e10a req-9da62895-c53d-4ff3-9361-511ba530195e service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f383169-7718-4bb4-88fa-ad8d3e6ef383 req-d953f799-8e28-46c0-a0c7-cf8ff8866d73 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Received event network-vif-deleted-58242289-8f80-4512-8cdb-0847afd81d42 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:52 user nova-compute[70594]: INFO nova.compute.manager [req-9f383169-7718-4bb4-88fa-ad8d3e6ef383 req-d953f799-8e28-46c0-a0c7-cf8ff8866d73 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Neutron deleted interface 58242289-8f80-4512-8cdb-0847afd81d42; detaching it from the instance and deleting it from the info cache
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f383169-7718-4bb4-88fa-ad8d3e6ef383 req-d953f799-8e28-46c0-a0c7-cf8ff8866d73 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:04:52 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Took 1.11 seconds to deallocate network for instance.
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f383169-7718-4bb4-88fa-ad8d3e6ef383 req-d953f799-8e28-46c0-a0c7-cf8ff8866d73 service nova] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Detach interface failed, port_id=58242289-8f80-4512-8cdb-0847afd81d42, reason: Instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 026577e6-2de3-45b9-adbf-7686e72a8c61 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391092.9840415, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:52 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Resumed (Lifecycle Event)
Jul 26 17:04:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b161ec21-fe21-4fb3-a008-6b7bf1edd0d7 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:53 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391092.9893641, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:04:53 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Started (Lifecycle Event)
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:53 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Deleted allocations for instance ae56085e-6a66-494f-9ec0-2397ec7eb4b0
Jul 26 17:04:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28d8293b-a28b-4ed4-8693-9a8a55cf6765 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.057s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.094s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:53 user nova-compute[70594]: INFO nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] During sync_power_state the instance has a pending task (deleting). Skip.
Jul 26 17:04:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "ae56085e-6a66-494f-9ec0-2397ec7eb4b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:04:57 user nova-compute[70594]: INFO nova.compute.claims [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Claim successful on node user
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:04:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:04:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:04:57 user nova-compute[70594]: INFO nova.virt.block_device [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Booting with volume 97b1271d-393d-49d8-9a17-cb7018f78fa5 at /dev/vda
Jul 26 17:04:57 user nova-compute[70594]: DEBUG os_brick.utils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[17022fb4-2aa4-406e-a998-f14cb8d77f66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdcdd57-36ab-43a2-a340-86b26696fe9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1957e-2f41-4cc2-a4e7-118265cea145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519f08a-e1d1-40d2-8d29-cd054639a165]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:04:58 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:04:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce6ed57-9fa6-432f-95bf-a6db97c0d119]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG os_brick.utils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updating existing volume attachment record: f88d8ef1-d724-4437-b250-dd1f07a340c8 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG nova.policy [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f042f51e92ac400ea26bce166a410123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75af562500b4c6a8586de2079994e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:04:58 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Successfully created port: f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "6be14a61-4040-441b-ad4c-7ec97285c610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:04:59 user nova-compute[70594]: INFO nova.compute.claims [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Claim successful on node user
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Successfully updated port: f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquired lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:04:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-changed-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Refreshing instance network info cache due to event network-changed-f21510ad-d95a-446c-af00-d2ec1a59754e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] Acquiring lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:04:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:05:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Creating image(s)
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "/opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "/opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "/opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.policy [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32813f7d98cd485d9b69a8ca4c7a1f7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283afd57674e453b8a19d978ada8790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk 1073741824" returned: 0 in 0.046s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updating instance_info_cache with network_info: [{"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Releasing lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance network_info: |[{"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] Acquired lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.network.neutron [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Refreshing network info cache for port f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Cannot resize image /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lazy-loading 'migration_context' on Instance uuid 6be14a61-4040-441b-ad4c-7ec97285c610 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Ensure instance console log exists: /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Successfully created port: 6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updated VIF entry in instance network info cache for port f21510ad-d95a-446c-af00-d2ec1a59754e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updating instance_info_cache with network_info: [{"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-786f51db-8b7d-41bb-bb16-0f60d216e749 req-2fa712b2-23cf-47b5-8085-d3b4cf0e269f service nova] Releasing lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Successfully updated port: 6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "refresh_cache-6be14a61-4040-441b-ad4c-7ec97285c610" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquired lock "refresh_cache-6be14a61-4040-441b-ad4c-7ec97285c610" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-changed-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Refreshing instance network info cache due to event network-changed-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] Acquiring lock "refresh_cache-6be14a61-4040-441b-ad4c-7ec97285c610" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Updating instance_info_cache with network_info: [{"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Releasing lock "refresh_cache-6be14a61-4040-441b-ad4c-7ec97285c610" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Instance network_info: |[{"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] Acquired lock "refresh_cache-6be14a61-4040-441b-ad4c-7ec97285c610" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Refreshing network info cache for port 6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Start _get_guest_xml network_info=[{"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:05:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-28898448',display_name='tempest-VolumesActionsTest-instance-28898448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-28898448',id=23,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='283afd57674e453b8a19d978ada8790a',ramdisk_id='',reservation_id='r-9xli5ary',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-642530868',owner_user_name='tempest-VolumesActionsTest-642530868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:05:00Z,user_data=None,user_id='32813f7d98cd485d9b69a8ca4c7a1f7a',uuid=6be14a61-4040-441b-ad4c-7ec97285c610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Converting VIF {"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lazy-loading 'pci_devices' on Instance uuid 6be14a61-4040-441b-ad4c-7ec97285c610 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:05:02 user nova-compute[70594]:   <uuid>6be14a61-4040-441b-ad4c-7ec97285c610</uuid>
Jul 26 17:05:02 user nova-compute[70594]:   <name>instance-00000017</name>
Jul 26 17:05:02 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:05:02 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:05:02 user nova-compute[70594]:   <metadata>
Jul 26 17:05:02 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:05:02 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:05:02 user nova-compute[70594]:       <nova:name>tempest-VolumesActionsTest-instance-28898448</nova:name>
Jul 26 17:05:02 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:05:02</nova:creationTime>
Jul 26 17:05:02 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:05:02 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:05:02 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:05:02 user nova-compute[70594]:       <nova:owner>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:user uuid="32813f7d98cd485d9b69a8ca4c7a1f7a">tempest-VolumesActionsTest-642530868-project-member</nova:user>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:project uuid="283afd57674e453b8a19d978ada8790a">tempest-VolumesActionsTest-642530868</nova:project>
Jul 26 17:05:02 user nova-compute[70594]:       </nova:owner>
Jul 26 17:05:02 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:05:02 user nova-compute[70594]:       <nova:ports>
Jul 26 17:05:02 user nova-compute[70594]:         <nova:port uuid="6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5">
Jul 26 17:05:02 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 26 17:05:02 user nova-compute[70594]:         </nova:port>
Jul 26 17:05:02 user nova-compute[70594]:       </nova:ports>
Jul 26 17:05:02 user nova-compute[70594]:     </nova:instance>
Jul 26 17:05:02 user nova-compute[70594]:   </metadata>
Jul 26 17:05:02 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:05:02 user nova-compute[70594]:     <system>
Jul 26 17:05:02 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:05:02 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:05:02 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:05:02 user nova-compute[70594]:       <entry name="serial">6be14a61-4040-441b-ad4c-7ec97285c610</entry>
Jul 26 17:05:02 user nova-compute[70594]:       <entry name="uuid">6be14a61-4040-441b-ad4c-7ec97285c610</entry>
Jul 26 17:05:02 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:05:02 user nova-compute[70594]:     </system>
Jul 26 17:05:02 user nova-compute[70594]:   </sysinfo>
Jul 26 17:05:02 user nova-compute[70594]:   <os>
Jul 26 17:05:02 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:05:02 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:05:02 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:05:02 user nova-compute[70594]:   </os>
Jul 26 17:05:02 user nova-compute[70594]:   <features>
Jul 26 17:05:02 user nova-compute[70594]:     <acpi/>
Jul 26 17:05:02 user nova-compute[70594]:     <apic/>
Jul 26 17:05:02 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:05:02 user nova-compute[70594]:   </features>
Jul 26 17:05:02 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:05:02 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:05:02 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:05:02 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:05:02 user nova-compute[70594]:   </clock>
Jul 26 17:05:02 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:05:02 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:05:02 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:05:02 user nova-compute[70594]:   </cpu>
Jul 26 17:05:02 user nova-compute[70594]:   <devices>
Jul 26 17:05:02 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:05:02 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:05:02 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk"/>
Jul 26 17:05:02 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:05:02 user nova-compute[70594]:     </disk>
Jul 26 17:05:02 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:05:02 user nova-compute[70594]:       <mac address="fa:16:3e:b0:ff:4c"/>
Jul 26 17:05:02 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:05:02 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:05:02 user nova-compute[70594]:       <target dev="tap6fb18d6d-3e"/>
Jul 26 17:05:02 user nova-compute[70594]:     </interface>
Jul 26 17:05:02 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:05:02 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/console.log" append="off"/>
Jul 26 17:05:02 user nova-compute[70594]:     </serial>
Jul 26 17:05:02 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:05:02 user nova-compute[70594]:     <video>
Jul 26 17:05:02 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:05:02 user nova-compute[70594]:     </video>
Jul 26 17:05:02 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:05:02 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:05:02 user nova-compute[70594]:     </rng>
Jul 26 17:05:02 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:05:02 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:05:02 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:05:02 user nova-compute[70594]:     </memballoon>
Jul 26 17:05:02 user nova-compute[70594]:   </devices>
Jul 26 17:05:02 user nova-compute[70594]: </domain>
Jul 26 17:05:02 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-28898448',display_name='tempest-VolumesActionsTest-instance-28898448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-28898448',id=23,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='283afd57674e453b8a19d978ada8790a',ramdisk_id='',reservation_id='r-9xli5ary',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-642530868',owner_user_name='tempest-VolumesActionsTest-642530868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:05:00Z,user_data=None,user_id='32813f7d98cd485d9b69a8ca4c7a1f7a',uuid=6be14a61-4040-441b-ad4c-7ec97285c610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Converting VIF {"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG os_vif [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fb18d6d-3e, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fb18d6d-3e, col_values=(('external_ids', {'iface-id': '6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:ff:4c', 'vm-uuid': '6be14a61-4040-441b-ad4c-7ec97285c610'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:02 user nova-compute[70594]: INFO os_vif [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e')
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] No VIF found with MAC fa:16:3e:b0:ff:4c, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Updated VIF entry in instance network info cache for port 6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Updating instance_info_cache with network_info: [{"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f874c2e2-9570-484d-b5e8-931051437c75 req-dcffb345-d9ed-4202-8b75-5767805e297c service nova] Releasing lock "refresh_cache-6be14a61-4040-441b-ad4c-7ec97285c610" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:05:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391106.5454543, 6be14a61-4040-441b-ad4c-7ec97285c610 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] VM Resumed (Lifecycle Event)
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391091.5584228, ae56085e-6a66-494f-9ec0-2397ec7eb4b0 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] VM Stopped (Lifecycle Event)
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-242fb24b-23d1-4bd3-86fe-1c983eafb786 req-5a4b15fc-79ef-448e-8adf-169874b580ee service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-242fb24b-23d1-4bd3-86fe-1c983eafb786 req-5a4b15fc-79ef-448e-8adf-169874b580ee service nova] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-242fb24b-23d1-4bd3-86fe-1c983eafb786 req-5a4b15fc-79ef-448e-8adf-169874b580ee service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-242fb24b-23d1-4bd3-86fe-1c983eafb786 req-5a4b15fc-79ef-448e-8adf-169874b580ee service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-242fb24b-23d1-4bd3-86fe-1c983eafb786 req-5a4b15fc-79ef-448e-8adf-169874b580ee service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] No waiting events found dispatching network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:06 user nova-compute[70594]: WARNING nova.compute.manager [req-242fb24b-23d1-4bd3-86fe-1c983eafb786 req-5a4b15fc-79ef-448e-8adf-169874b580ee service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received unexpected event network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 for instance with vm_state building and task_state spawning.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-74a42f44-0ad2-4860-87f9-93b886896c3a req-59f2321a-624a-4ced-b272-7c23029c2ebc service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-74a42f44-0ad2-4860-87f9-93b886896c3a req-59f2321a-624a-4ced-b272-7c23029c2ebc service nova] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-74a42f44-0ad2-4860-87f9-93b886896c3a req-59f2321a-624a-4ced-b272-7c23029c2ebc service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-74a42f44-0ad2-4860-87f9-93b886896c3a req-59f2321a-624a-4ced-b272-7c23029c2ebc service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-74a42f44-0ad2-4860-87f9-93b886896c3a req-59f2321a-624a-4ced-b272-7c23029c2ebc service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] No waiting events found dispatching network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:06 user nova-compute[70594]: WARNING nova.compute.manager [req-74a42f44-0ad2-4860-87f9-93b886896c3a req-59f2321a-624a-4ced-b272-7c23029c2ebc service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received unexpected event network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 for instance with vm_state building and task_state spawning.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2de514b2-34ed-4e30-a322-22286ae4453a None None] [instance: ae56085e-6a66-494f-9ec0-2397ec7eb4b0] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Instance spawned successfully.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:05:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7089MB free_disk=25.325275421142578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391106.546541, 6be14a61-4040-441b-ad4c-7ec97285c610 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] VM Started (Lifecycle Event)
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Took 6.81 seconds to spawn the instance on the hypervisor.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:05:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Creating image(s)
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Start _get_guest_xml network_info=[{"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc2f6a06-3514-44fb-9391-fce3c1182e27', 'attached_at': '', 'detached_at': '', 'volume_id': '97b1271d-393d-49d8-9a17-cb7018f78fa5', 'serial': '97b1271d-393d-49d8-9a17-cb7018f78fa5'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'f88d8ef1-d724-4437-b250-dd1f07a340c8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:05:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:05:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:05:07 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:05:07 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:05:07 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3f5841c2-e400-48d9-92dd-d776150c7849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 76a02a97-4400-44d2-8655-89fc12f69682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f2b78e55-2422-4aa4-9cc7-cec7a964d901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance fc2f6a06-3514-44fb-9391-fce3c1182e27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6be14a61-4040-441b-ad4c-7ec97285c610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:05:07 user nova-compute[70594]: INFO nova.compute.manager [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Took 7.80 seconds to build instance.
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[463e2ab3-cca0-4c04-9774-14aa2f1d21b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:05:07 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2cdfdaff-456a-430b-baad-af3e7218ec7f tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "6be14a61-4040-441b-ad4c-7ec97285c610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.927s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abee85f-0ca3-4b37-bcc7-b91d5793b4d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5] added
Jul 26 17:05:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbcfb38-f615-4cd9-9934-6895e20366a2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5acd34-2562-4717-be69-d68b2cb0d26d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdzcYGMI {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdzcYGMI" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a1d39-d10e-4a4e-8ef8-f9662302cc1e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdzcYGMI'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2571ee9-c688-4f3d-a72f-d4754e99b578]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e508be7-984a-4b63-bb19-43e6afd77eef]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d040c4-5a18-481e-ae36-f6dd5bd22edc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]
Jul 26 17:05:07 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.
Jul 26 17:05:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efbb8b0-0662-409c-b09b-ee8f54fb78fe]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fce091-f797-45e6-9c17-38541a6b2e2a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:05:07 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[20126d14-4793-44cb-ac50-f0a02b18c333]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23164313261313634', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164313261313634', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-180134213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-180134213',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEcRpCH5inq5cCtNWGZ0sP8y/LsMiqplLE8iHhed0eAKEyo6FWVuTdfDcFiP4qVJUCdHqt6pEGOStBDb13bq3q9WqN+RbObuu/4z6fq21wNlTLOSGkHBxLbST6DOWgonQ==',key_name='tempest-keypair-1106897005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-hq0pmkvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=fc2f6a06-3514-44fb-9391-fce3c1182e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.objects.instance [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:05:08 user nova-compute[70594]:   <uuid>fc2f6a06-3514-44fb-9391-fce3c1182e27</uuid>
Jul 26 17:05:08 user nova-compute[70594]:   <name>instance-00000016</name>
Jul 26 17:05:08 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:05:08 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:05:08 user nova-compute[70594]:   <metadata>
Jul 26 17:05:08 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:05:08 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:05:08 user nova-compute[70594]:       <nova:name>tempest-ServerActionsV293TestJSON-server-180134213</nova:name>
Jul 26 17:05:08 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:05:06</nova:creationTime>
Jul 26 17:05:08 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:05:08 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:05:08 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:05:08 user nova-compute[70594]:       <nova:owner>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:user uuid="f042f51e92ac400ea26bce166a410123">tempest-ServerActionsV293TestJSON-607585814-project-member</nova:user>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:project uuid="c75af562500b4c6a8586de2079994e90">tempest-ServerActionsV293TestJSON-607585814</nova:project>
Jul 26 17:05:08 user nova-compute[70594]:       </nova:owner>
Jul 26 17:05:08 user nova-compute[70594]:       <nova:ports>
Jul 26 17:05:08 user nova-compute[70594]:         <nova:port uuid="f21510ad-d95a-446c-af00-d2ec1a59754e">
Jul 26 17:05:08 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 26 17:05:08 user nova-compute[70594]:         </nova:port>
Jul 26 17:05:08 user nova-compute[70594]:       </nova:ports>
Jul 26 17:05:08 user nova-compute[70594]:     </nova:instance>
Jul 26 17:05:08 user nova-compute[70594]:   </metadata>
Jul 26 17:05:08 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:05:08 user nova-compute[70594]:     <system>
Jul 26 17:05:08 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:05:08 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:05:08 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:05:08 user nova-compute[70594]:       <entry name="serial">fc2f6a06-3514-44fb-9391-fce3c1182e27</entry>
Jul 26 17:05:08 user nova-compute[70594]:       <entry name="uuid">fc2f6a06-3514-44fb-9391-fce3c1182e27</entry>
Jul 26 17:05:08 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:05:08 user nova-compute[70594]:     </system>
Jul 26 17:05:08 user nova-compute[70594]:   </sysinfo>
Jul 26 17:05:08 user nova-compute[70594]:   <os>
Jul 26 17:05:08 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:05:08 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:05:08 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:05:08 user nova-compute[70594]:   </os>
Jul 26 17:05:08 user nova-compute[70594]:   <features>
Jul 26 17:05:08 user nova-compute[70594]:     <acpi/>
Jul 26 17:05:08 user nova-compute[70594]:     <apic/>
Jul 26 17:05:08 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:05:08 user nova-compute[70594]:   </features>
Jul 26 17:05:08 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:05:08 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:05:08 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:05:08 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:05:08 user nova-compute[70594]:   </clock>
Jul 26 17:05:08 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:05:08 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:05:08 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:05:08 user nova-compute[70594]:   </cpu>
Jul 26 17:05:08 user nova-compute[70594]:   <devices>
Jul 26 17:05:08 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:05:08 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:05:08 user nova-compute[70594]:       <source dev="/dev/sde"/>
Jul 26 17:05:08 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:05:08 user nova-compute[70594]:       <serial>97b1271d-393d-49d8-9a17-cb7018f78fa5</serial>
Jul 26 17:05:08 user nova-compute[70594]:     </disk>
Jul 26 17:05:08 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:05:08 user nova-compute[70594]:       <mac address="fa:16:3e:69:ab:5e"/>
Jul 26 17:05:08 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:05:08 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:05:08 user nova-compute[70594]:       <target dev="tapf21510ad-d9"/>
Jul 26 17:05:08 user nova-compute[70594]:     </interface>
Jul 26 17:05:08 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:05:08 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27/console.log" append="off"/>
Jul 26 17:05:08 user nova-compute[70594]:     </serial>
Jul 26 17:05:08 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:05:08 user nova-compute[70594]:     <video>
Jul 26 17:05:08 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:05:08 user nova-compute[70594]:     </video>
Jul 26 17:05:08 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:05:08 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:05:08 user nova-compute[70594]:     </rng>
Jul 26 17:05:08 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:05:08 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:05:08 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:05:08 user nova-compute[70594]:     </memballoon>
Jul 26 17:05:08 user nova-compute[70594]:   </devices>
Jul 26 17:05:08 user nova-compute[70594]: </domain>
Jul 26 17:05:08 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-180134213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-180134213',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEcRpCH5inq5cCtNWGZ0sP8y/LsMiqplLE8iHhed0eAKEyo6FWVuTdfDcFiP4qVJUCdHqt6pEGOStBDb13bq3q9WqN+RbObuu/4z6fq21wNlTLOSGkHBxLbST6DOWgonQ==',key_name='tempest-keypair-1106897005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-hq0pmkvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=fc2f6a06-3514-44fb-9391-fce3c1182e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG os_vif [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf21510ad-d9, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf21510ad-d9, col_values=(('external_ids', {'iface-id': 'f21510ad-d95a-446c-af00-d2ec1a59754e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:ab:5e', 'vm-uuid': 'fc2f6a06-3514-44fb-9391-fce3c1182e27'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:08 user nova-compute[70594]: INFO os_vif [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9')
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:05:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] No VIF found with MAC fa:16:3e:69:ab:5e, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-86c3d02c-474f-438c-955b-129a0782440a req-84b7cc1d-6afd-481a-9b90-fd5c91d7c368 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-86c3d02c-474f-438c-955b-129a0782440a req-84b7cc1d-6afd-481a-9b90-fd5c91d7c368 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-86c3d02c-474f-438c-955b-129a0782440a req-84b7cc1d-6afd-481a-9b90-fd5c91d7c368 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-86c3d02c-474f-438c-955b-129a0782440a req-84b7cc1d-6afd-481a-9b90-fd5c91d7c368 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-86c3d02c-474f-438c-955b-129a0782440a req-84b7cc1d-6afd-481a-9b90-fd5c91d7c368 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:10 user nova-compute[70594]: WARNING nova.compute.manager [req-86c3d02c-474f-438c-955b-129a0782440a req-84b7cc1d-6afd-481a-9b90-fd5c91d7c368 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state building and task_state spawning.
Jul 26 17:05:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:11 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391111.9922097, fc2f6a06-3514-44fb-9391-fce3c1182e27 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] VM Resumed (Lifecycle Event)
Jul 26 17:05:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:05:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:05:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance spawned successfully.
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391111.9933321, fc2f6a06-3514-44fb-9391-fce3c1182e27 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] VM Started (Lifecycle Event)
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:05:12 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:05:12 user nova-compute[70594]: INFO nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Took 5.13 seconds to spawn the instance on the hypervisor.
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8f62eb-aed0-4e76-889c-3eb90124ec99 req-b094d636-b789-43db-8e8a-7e4f1c9a5c65 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8f62eb-aed0-4e76-889c-3eb90124ec99 req-b094d636-b789-43db-8e8a-7e4f1c9a5c65 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8f62eb-aed0-4e76-889c-3eb90124ec99 req-b094d636-b789-43db-8e8a-7e4f1c9a5c65 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b8f62eb-aed0-4e76-889c-3eb90124ec99 req-b094d636-b789-43db-8e8a-7e4f1c9a5c65 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b8f62eb-aed0-4e76-889c-3eb90124ec99 req-b094d636-b789-43db-8e8a-7e4f1c9a5c65 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:12 user nova-compute[70594]: WARNING nova.compute.manager [req-5b8f62eb-aed0-4e76-889c-3eb90124ec99 req-b094d636-b789-43db-8e8a-7e4f1c9a5c65 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state building and task_state spawning.
Jul 26 17:05:12 user nova-compute[70594]: INFO nova.compute.manager [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Took 14.99 seconds to build instance.
Jul 26 17:05:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bdd157d2-4f8b-4f7b-abf8-7d7a25245646 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.080s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:31 user nova-compute[70594]: INFO nova.compute.manager [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Terminating instance
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-ce928160-612e-42e4-812b-e300fe57fd0b req-86831906-63f7-4cf2-8de1-47bbc0fe0e3d service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-unplugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ce928160-612e-42e4-812b-e300fe57fd0b req-86831906-63f7-4cf2-8de1-47bbc0fe0e3d service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ce928160-612e-42e4-812b-e300fe57fd0b req-86831906-63f7-4cf2-8de1-47bbc0fe0e3d service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ce928160-612e-42e4-812b-e300fe57fd0b req-86831906-63f7-4cf2-8de1-47bbc0fe0e3d service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-ce928160-612e-42e4-812b-e300fe57fd0b req-86831906-63f7-4cf2-8de1-47bbc0fe0e3d service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-unplugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-ce928160-612e-42e4-812b-e300fe57fd0b req-86831906-63f7-4cf2-8de1-47bbc0fe0e3d service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-unplugged-63fbb581-4956-4207-be9e-689d6b22104d for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:05:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Instance destroyed successfully.
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lazy-loading 'resources' on Instance uuid f2b78e55-2422-4aa4-9cc7-cec7a964d901 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-26T17:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1535981382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1535981382',id=18,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbaKFrduYsOVK6Hawqukiz9RYZGoW02fl2ff/3Iy7AvOgVQhES8ZAqfDV9D6TLyXJbxZCyjRDMU2VzYKvVOmfz/0eLonhiDn5XhBpjZjad8GBtIfv8CBTWdKDw923BQqQ==',key_name='tempest-keypair-904534704',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae4c76df80df42b0b4744e11d2f61b04',ramdisk_id='',reservation_id='r-3q063jcg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-15597414',owner_user_name='tempest-TaggedAttachmentsTest-15597414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472502ad99de4e669f2adb09afefe2d4',uuid=f2b78e55-2422-4aa4-9cc7-cec7a964d901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converting VIF {"id": "63fbb581-4956-4207-be9e-689d6b22104d", "address": "fa:16:3e:85:13:20", "network": {"id": "bf0a1803-9720-4cd0-8a24-95def0139ea3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1165847684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4c76df80df42b0b4744e11d2f61b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fbb581-49", "ovs_interfaceid": "63fbb581-4956-4207-be9e-689d6b22104d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG os_vif [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63fbb581-49, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:05:31 user nova-compute[70594]: INFO os_vif [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:13:20,bridge_name='br-int',has_traffic_filtering=True,id=63fbb581-4956-4207-be9e-689d6b22104d,network=Network(bf0a1803-9720-4cd0-8a24-95def0139ea3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fbb581-49')
Jul 26 17:05:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Deleting instance files /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901_del
Jul 26 17:05:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Deletion of /opt/stack/data/nova/instances/f2b78e55-2422-4aa4-9cc7-cec7a964d901_del complete
Jul 26 17:05:32 user nova-compute[70594]: INFO nova.compute.manager [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 26 17:05:32 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:05:32 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:05:32 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:33 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Took 1.13 seconds to deallocate network for instance.
Jul 26 17:05:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-1e32098d-85a0-4cf8-a890-b16b78230c1c req-ead8ef35-bff6-4014-9c9d-2dad4d6289c6 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-deleted-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-46cd0437-e606-4958-b621-9b841359e677 req-7c9be9a0-f857-4bfb-b873-88bec21cca67 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received event network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46cd0437-e606-4958-b621-9b841359e677 req-7c9be9a0-f857-4bfb-b873-88bec21cca67 service nova] Acquiring lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46cd0437-e606-4958-b621-9b841359e677 req-7c9be9a0-f857-4bfb-b873-88bec21cca67 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-46cd0437-e606-4958-b621-9b841359e677 req-7c9be9a0-f857-4bfb-b873-88bec21cca67 service nova] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-46cd0437-e606-4958-b621-9b841359e677 req-7c9be9a0-f857-4bfb-b873-88bec21cca67 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] No waiting events found dispatching network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:33 user nova-compute[70594]: WARNING nova.compute.manager [req-46cd0437-e606-4958-b621-9b841359e677 req-7c9be9a0-f857-4bfb-b873-88bec21cca67 service nova] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Received unexpected event network-vif-plugged-63fbb581-4956-4207-be9e-689d6b22104d for instance with vm_state deleted and task_state None.
Jul 26 17:05:33 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:05:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.564s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:33 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Deleted allocations for instance f2b78e55-2422-4aa4-9cc7-cec7a964d901
Jul 26 17:05:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-101af40b-eb20-4b67-9dac-1fb8caefd6e9 tempest-TaggedAttachmentsTest-15597414 tempest-TaggedAttachmentsTest-15597414-project-member] Lock "f2b78e55-2422-4aa4-9cc7-cec7a964d901" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.976s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:34 user nova-compute[70594]: INFO nova.compute.manager [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Terminating instance
Jul 26 17:05:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Instance destroyed successfully.
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lazy-loading 'resources' on Instance uuid 3f5841c2-e400-48d9-92dd-d776150c7849 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-961710201',display_name='tempest-ServerStableDeviceRescueTest-server-961710201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-961710201',id=5,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpQybbYth7qArntY2y7E3HyZ9i+RshZoLnj2sKjelEF04rnuFNHD3e0iuWndaLHwqvKxmXjAggVEmdBbCrxrzpCYISl7Io+U2io7MbvEE2otw7D6PrY/jIvF2m9oMpFEA==',key_name='tempest-keypair-167561146',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae951bdcec3747a2a9fdd2f2ce28d3f0',ramdisk_id='',reservation_id='r-6zptpueb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-263207676',owner_user_name='tempest-ServerStableDeviceRescueTest-263207676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d46824c7e6747fd8ab11c920e79a58e',uuid=3f5841c2-e400-48d9-92dd-d776150c7849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converting VIF {"id": "f057bd54-b76f-4591-a8a7-b97bdb536421", "address": "fa:16:3e:71:c3:4d", "network": {"id": "6d9e3312-4a8d-4b64-b542-90687c2e6d5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1214407482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae951bdcec3747a2a9fdd2f2ce28d3f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf057bd54-b7", "ovs_interfaceid": "f057bd54-b76f-4591-a8a7-b97bdb536421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG os_vif [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf057bd54-b7, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:05:35 user nova-compute[70594]: INFO os_vif [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:4d,bridge_name='br-int',has_traffic_filtering=True,id=f057bd54-b76f-4591-a8a7-b97bdb536421,network=Network(6d9e3312-4a8d-4b64-b542-90687c2e6d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf057bd54-b7')
Jul 26 17:05:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Deleting instance files /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849_del
Jul 26 17:05:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Deletion of /opt/stack/data/nova/instances/3f5841c2-e400-48d9-92dd-d776150c7849_del complete
Jul 26 17:05:35 user nova-compute[70594]: INFO nova.compute.manager [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-unplugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] Acquiring lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] Lock "3f5841c2-e400-48d9-92dd-d776150c7849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] No waiting events found dispatching network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:35 user nova-compute[70594]: WARNING nova.compute.manager [req-8a505a81-6476-47f5-89a4-b26f6c9d3dfe req-62077126-cb5a-4c23-889d-daae5fea4368 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received unexpected event network-vif-plugged-f057bd54-b76f-4591-a8a7-b97bdb536421 for instance with vm_state active and task_state deleting.
Jul 26 17:05:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:36 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:36 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Took 1.40 seconds to deallocate network for instance.
Jul 26 17:05:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:37 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:05:37 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:05:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:37 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Deleted allocations for instance 3f5841c2-e400-48d9-92dd-d776150c7849
Jul 26 17:05:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d65a9b37-1c57-42ce-9f43-3af4d5c5b7dc tempest-ServerStableDeviceRescueTest-263207676 tempest-ServerStableDeviceRescueTest-263207676-project-member] Lock "3f5841c2-e400-48d9-92dd-d776150c7849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-b339f9de-876f-4b7e-816c-6c1593bccb98 req-005811f9-4781-4ca2-89e4-2419b8f96423 service nova] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Received event network-vif-deleted-f057bd54-b76f-4591-a8a7-b97bdb536421 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:05:44 user nova-compute[70594]: INFO nova.compute.claims [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Claim successful on node user
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:05:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:05:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.policy [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9714a3b9e9d44f6b22c49d3d495d7ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f389f41a191747e68ceeb776fdcbff40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:05:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Creating image(s)
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk 1073741824" returned: 0 in 0.047s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Successfully created port: a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Cannot resize image /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'migration_context' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Ensure instance console log exists: /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Successfully updated port: a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing instance network info cache due to event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391131.8958354, f2b78e55-2422-4aa4-9cc7-cec7a964d901 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:46 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] VM Stopped (Lifecycle Event)
Jul 26 17:05:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ceeb0ef-5abf-41ab-b8e1-d2e23207ff51 None None] [instance: f2b78e55-2422-4aa4-9cc7-cec7a964d901] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance network_info: |[{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Start _get_guest_xml network_info=[{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:05:47 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:47 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-971400957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-971400957',id=24,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAf5rqS8Wqw9PQMSjYkvvxQN63l0mAm/rtFRp46spruamljCb7ZCObtt5TmiXb4sh0Ng2eA9FbtdAaJFc3QYZXih6J5yWU3QqpVH1hVnKPRO2LUdsEm4kCpz/MZ474Iwg==',key_name='tempest-keypair-1944995380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-1rhi3h8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=572dfc14-2bf8-4947-9396-63cd364ccf39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'pci_devices' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:05:47 user nova-compute[70594]:   <uuid>572dfc14-2bf8-4947-9396-63cd364ccf39</uuid>
Jul 26 17:05:47 user nova-compute[70594]:   <name>instance-00000018</name>
Jul 26 17:05:47 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:05:47 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:05:47 user nova-compute[70594]:   <metadata>
Jul 26 17:05:47 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:05:47 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:05:47 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-971400957</nova:name>
Jul 26 17:05:47 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:05:47</nova:creationTime>
Jul 26 17:05:47 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:05:47 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:05:47 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:05:47 user nova-compute[70594]:       <nova:owner>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:user uuid="e9714a3b9e9d44f6b22c49d3d495d7ad">tempest-AttachVolumeShelveTestJSON-1781489687-project-member</nova:user>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:project uuid="f389f41a191747e68ceeb776fdcbff40">tempest-AttachVolumeShelveTestJSON-1781489687</nova:project>
Jul 26 17:05:47 user nova-compute[70594]:       </nova:owner>
Jul 26 17:05:47 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:05:47 user nova-compute[70594]:       <nova:ports>
Jul 26 17:05:47 user nova-compute[70594]:         <nova:port uuid="a89a2f0d-bff5-44b5-a17a-d5037afa4f05">
Jul 26 17:05:47 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:05:47 user nova-compute[70594]:         </nova:port>
Jul 26 17:05:47 user nova-compute[70594]:       </nova:ports>
Jul 26 17:05:47 user nova-compute[70594]:     </nova:instance>
Jul 26 17:05:47 user nova-compute[70594]:   </metadata>
Jul 26 17:05:47 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:05:47 user nova-compute[70594]:     <system>
Jul 26 17:05:47 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:05:47 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:05:47 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:05:47 user nova-compute[70594]:       <entry name="serial">572dfc14-2bf8-4947-9396-63cd364ccf39</entry>
Jul 26 17:05:47 user nova-compute[70594]:       <entry name="uuid">572dfc14-2bf8-4947-9396-63cd364ccf39</entry>
Jul 26 17:05:47 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:05:47 user nova-compute[70594]:     </system>
Jul 26 17:05:47 user nova-compute[70594]:   </sysinfo>
Jul 26 17:05:47 user nova-compute[70594]:   <os>
Jul 26 17:05:47 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:05:47 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:05:47 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:05:47 user nova-compute[70594]:   </os>
Jul 26 17:05:47 user nova-compute[70594]:   <features>
Jul 26 17:05:47 user nova-compute[70594]:     <acpi/>
Jul 26 17:05:47 user nova-compute[70594]:     <apic/>
Jul 26 17:05:47 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:05:47 user nova-compute[70594]:   </features>
Jul 26 17:05:47 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:05:47 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:05:47 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:05:47 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:05:47 user nova-compute[70594]:   </clock>
Jul 26 17:05:47 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:05:47 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:05:47 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:05:47 user nova-compute[70594]:   </cpu>
Jul 26 17:05:47 user nova-compute[70594]:   <devices>
Jul 26 17:05:47 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:05:47 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:05:47 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk"/>
Jul 26 17:05:47 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:05:47 user nova-compute[70594]:     </disk>
Jul 26 17:05:47 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:05:47 user nova-compute[70594]:       <mac address="fa:16:3e:19:72:22"/>
Jul 26 17:05:47 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:05:47 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:05:47 user nova-compute[70594]:       <target dev="tapa89a2f0d-bf"/>
Jul 26 17:05:47 user nova-compute[70594]:     </interface>
Jul 26 17:05:47 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:05:47 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/console.log" append="off"/>
Jul 26 17:05:47 user nova-compute[70594]:     </serial>
Jul 26 17:05:47 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:05:47 user nova-compute[70594]:     <video>
Jul 26 17:05:47 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:05:47 user nova-compute[70594]:     </video>
Jul 26 17:05:47 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:05:47 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:05:47 user nova-compute[70594]:     </rng>
Jul 26 17:05:47 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:05:47 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:05:47 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:05:47 user nova-compute[70594]:     </memballoon>
Jul 26 17:05:47 user nova-compute[70594]:   </devices>
Jul 26 17:05:47 user nova-compute[70594]: </domain>
Jul 26 17:05:47 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-971400957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-971400957',id=24,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAf5rqS8Wqw9PQMSjYkvvxQN63l0mAm/rtFRp46spruamljCb7ZCObtt5TmiXb4sh0Ng2eA9FbtdAaJFc3QYZXih6J5yWU3QqpVH1hVnKPRO2LUdsEm4kCpz/MZ474Iwg==',key_name='tempest-keypair-1944995380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-1rhi3h8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=572dfc14-2bf8-4947-9396-63cd364ccf39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG os_vif [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa89a2f0d-bf, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa89a2f0d-bf, col_values=(('external_ids', {'iface-id': 'a89a2f0d-bff5-44b5-a17a-d5037afa4f05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:72:22', 'vm-uuid': '572dfc14-2bf8-4947-9396-63cd364ccf39'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:47 user nova-compute[70594]: INFO os_vif [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf')
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No VIF found with MAC fa:16:3e:19:72:22, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updated VIF entry in instance network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:05:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-09c70174-facd-4c64-ae0b-852b14b721a0 req-5cc6c5ef-a39b-48d6-98c9-f30238c34b1c service nova] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:05:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-a2200939-2c45-48e3-a017-8586437bb73d req-a723b3ca-0460-4f64-8253-c2f86a74e70b service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a2200939-2c45-48e3-a017-8586437bb73d req-a723b3ca-0460-4f64-8253-c2f86a74e70b service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a2200939-2c45-48e3-a017-8586437bb73d req-a723b3ca-0460-4f64-8253-c2f86a74e70b service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a2200939-2c45-48e3-a017-8586437bb73d req-a723b3ca-0460-4f64-8253-c2f86a74e70b service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-a2200939-2c45-48e3-a017-8586437bb73d req-a723b3ca-0460-4f64-8253-c2f86a74e70b service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:49 user nova-compute[70594]: WARNING nova.compute.manager [req-a2200939-2c45-48e3-a017-8586437bb73d req-a723b3ca-0460-4f64-8253-c2f86a74e70b service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state building and task_state spawning.
Jul 26 17:05:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:50 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391135.0333917, 3f5841c2-e400-48d9-92dd-d776150c7849 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:50 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] VM Stopped (Lifecycle Event)
Jul 26 17:05:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77ce2925-4263-4de6-98fc-d7c668f6cb05 None None] [instance: 3f5841c2-e400-48d9-92dd-d776150c7849] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391151.0793035, 572dfc14-2bf8-4947-9396-63cd364ccf39 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] VM Resumed (Lifecycle Event)
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance spawned successfully.
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391151.0818686, 572dfc14-2bf8-4947-9396-63cd364ccf39 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] VM Started (Lifecycle Event)
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-a9e5560d-9996-42c7-8f86-ea9a007ed130 req-3b5f5b47-047a-4ead-bef3-d42214e020c1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a9e5560d-9996-42c7-8f86-ea9a007ed130 req-3b5f5b47-047a-4ead-bef3-d42214e020c1 service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a9e5560d-9996-42c7-8f86-ea9a007ed130 req-3b5f5b47-047a-4ead-bef3-d42214e020c1 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a9e5560d-9996-42c7-8f86-ea9a007ed130 req-3b5f5b47-047a-4ead-bef3-d42214e020c1 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-a9e5560d-9996-42c7-8f86-ea9a007ed130 req-3b5f5b47-047a-4ead-bef3-d42214e020c1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:05:51 user nova-compute[70594]: WARNING nova.compute.manager [req-a9e5560d-9996-42c7-8f86-ea9a007ed130 req-3b5f5b47-047a-4ead-bef3-d42214e020c1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state building and task_state spawning.
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Took 6.11 seconds to spawn the instance on the hypervisor.
Jul 26 17:05:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:05:51 user nova-compute[70594]: INFO nova.compute.manager [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Took 6.90 seconds to build instance.
Jul 26 17:05:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7a6c6c90-55a3-40d1-abeb-4d1b3e5db644 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.996s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:05:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:05:58 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:00 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=6892MB free_disk=25.445003509521484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 76a02a97-4400-44d2-8655-89fc12f69682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance a624beaa-5c38-4aee-9c04-4e888e85f0f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance fc2f6a06-3514-44fb-9391-fce3c1182e27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6be14a61-4040-441b-ad4c-7ec97285c610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 572dfc14-2bf8-4947-9396-63cd364ccf39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:06:07 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid d51f1e40-acab-40c5-814d-ca5022cf04c7 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updating instance_info_cache with network_info: [{"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-d51f1e40-acab-40c5-814d-ca5022cf04c7" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-changed-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Refreshing instance network info cache due to event network-changed-8e748cd0-1b6b-4407-835c-2f923babe6a5. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] Acquiring lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] Acquired lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG nova.network.neutron [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Refreshing network info cache for port 8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:09 user nova-compute[70594]: DEBUG nova.network.neutron [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updated VIF entry in instance network info cache for port 8e748cd0-1b6b-4407-835c-2f923babe6a5. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:09 user nova-compute[70594]: DEBUG nova.network.neutron [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updating instance_info_cache with network_info: [{"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4815657c-91b0-4074-a50d-dcde861ef28d req-4aa04eea-6a76-4fc9-8c04-548e5aaf7119 service nova] Releasing lock "refresh_cache-6ac8029d-1df8-4648-979f-8f4fee7fdab4" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lazy-loading 'flavor' on Instance uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:11 user nova-compute[70594]: INFO nova.compute.manager [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Attaching volume 2420a3c9-493c-4fb4-a181-f026386f73a7 to /dev/vdb
Jul 26 17:06:11 user nova-compute[70594]: DEBUG os_brick.utils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef8a51-5949-4834-b373-58952f548859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85666ce-4c79-49f4-bbab-81c5cbbb6153]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4640e0f-3210-4c28-b0d4-960fd1e13528]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507d106-5c82-4b13-b77c-690a6b53dffa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:06:12 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:06:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdbfacd-121e-4ddc-8661-0755293d4154]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG os_brick.utils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updating existing volume attachment record: c7322595-b702-4e55-8dbb-f5de471899aa {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:06:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:18 user nova-compute[70594]: INFO nova.compute.manager [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Rescuing
Jul 26 17:06:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:06:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzKHWsDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:19 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:19 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:19 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52148c1-55a7-4a17-b02d-ea6c50c9e50f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:06:19 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61ebb5-170b-463f-a7b7-fa5661b51c78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7] added
Jul 26 17:06:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-224cf23b-48c2-4050-a2b2-c7202c192851 req-939f1182-b302-4d35-b829-89abe8600575 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-224cf23b-48c2-4050-a2b2-c7202c192851 req-939f1182-b302-4d35-b829-89abe8600575 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-224cf23b-48c2-4050-a2b2-c7202c192851 req-939f1182-b302-4d35-b829-89abe8600575 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-224cf23b-48c2-4050-a2b2-c7202c192851 req-939f1182-b302-4d35-b829-89abe8600575 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-224cf23b-48c2-4050-a2b2-c7202c192851 req-939f1182-b302-4d35-b829-89abe8600575 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:19 user nova-compute[70594]: WARNING nova.compute.manager [req-224cf23b-48c2-4050-a2b2-c7202c192851 req-939f1182-b302-4d35-b829-89abe8600575 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state active and task_state rescuing.
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a101ba0-72b6-473b-a9be-c0566e357feb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1700bf5-19ab-4c56-b1fc-a601c11b7f1a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzKHWsDO {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzKHWsDO" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463c2cf-ddd5-4922-9fe9-0d93a725f500]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PzKHWsDO'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce979e78-6151-483c-947e-fd982f0010b3]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8508f337-71a4-4ca7-9d31-d1f97e76fca6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[142af866-a59e-485d-9b0d-0dac3b0d8e44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260]
Jul 26 17:06:19 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260] successful.
Jul 26 17:06:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4594ea-e5e8-4c99-922d-58d4fa4a5447]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8154fc26-e7be-4888-9096-8e3767fec1fc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)
Jul 26 17:06:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe8b8f-6c3b-42d5-955e-7996f285640c]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzKHWsDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:06:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance destroyed successfully.
Jul 26 17:06:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Attempting a stable device rescue
Jul 26 17:06:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70594) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:06:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Creating image(s)
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "b63b866cb1bed09936823de3e7d72f1c34757b49" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "b63b866cb1bed09936823de3e7d72f1c34757b49" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.949s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] <== connect_volume: return (1951ms) {'type': 'block', 'scsi_wwn': '23938313365313138', 'path': '/dev/sdf'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938313365313138', 'path': '/dev/sdf'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lazy-loading 'flavor' on Instance uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:06:21 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:06:21 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:06:21 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:06:21 user nova-compute[70594]:   <serial>2420a3c9-493c-4fb4-a181-f026386f73a7</serial>
Jul 26 17:06:21 user nova-compute[70594]: </disk>
Jul 26 17:06:21 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.part --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.virt.images [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] 5cf92a64-7a25-46ee-8551-32f95a7806cb was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.part /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-acc21254-cc8a-4284-9603-2a2ab1992b46 req-757c2137-4f66-4542-9ec8-a754bde76f80 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-acc21254-cc8a-4284-9603-2a2ab1992b46 req-757c2137-4f66-4542-9ec8-a754bde76f80 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-acc21254-cc8a-4284-9603-2a2ab1992b46 req-757c2137-4f66-4542-9ec8-a754bde76f80 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-acc21254-cc8a-4284-9603-2a2ab1992b46 req-757c2137-4f66-4542-9ec8-a754bde76f80 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-acc21254-cc8a-4284-9603-2a2ab1992b46 req-757c2137-4f66-4542-9ec8-a754bde76f80 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:21 user nova-compute[70594]: WARNING nova.compute.manager [req-acc21254-cc8a-4284-9603-2a2ab1992b46 req-757c2137-4f66-4542-9ec8-a754bde76f80 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state active and task_state rescuing.
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.part /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.converted" returned: 0 in 0.368s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] No VIF found with MAC fa:16:3e:5a:d0:9e, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "b63b866cb1bed09936823de3e7d72f1c34757b49" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.041s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "b63b866cb1bed09936823de3e7d72f1c34757b49" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "b63b866cb1bed09936823de3e7d72f1c34757b49" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49 --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ca26d0d4-74f8-4e00-b845-7dbf7e0bd4f0 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.177s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49 --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49,backing_fmt=raw /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b63b866cb1bed09936823de3e7d72f1c34757b49,backing_fmt=raw /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue" returned: 0 in 0.101s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "b63b866cb1bed09936823de3e7d72f1c34757b49" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'migration_context' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Start _get_guest_xml network_info=[{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "vif_mac": "fa:16:3e:d4:b7:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5cf92a64-7a25-46ee-8551-32f95a7806cb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8ef02326-71b1-43ca-a53d-c2f73b049896', 'attached_at': '', 'detached_at': '', 'volume_id': '55b56260-a269-4ce7-9398-b195ced9b560', 'serial': '55b56260-a269-4ce7-9398-b195ced9b560'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '71883000-97f6-4dc4-826e-1fc403cb719f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'resources' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:22 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:22 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:22 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5abd02-b370-48b1-8264-50fb2b5f72e9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rEjVCymI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 26 17:06:22 user nova-compute[70594]: node.name = iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:06:22 user nova-compute[70594]: node.tpgt = -1
Jul 26 17:06:22 user nova-compute[70594]: node.startup = automatic
Jul 26 17:06:22 user nova-compute[70594]: node.leading_login = No
Jul 26 17:06:22 user nova-compute[70594]: iface.iscsi_ifacename = default
Jul 26 17:06:22 user nova-compute[70594]: iface.net_ifacename = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.ipaddress = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.prefix_len = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.hwaddress = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.transport_name = tcp
Jul 26 17:06:22 user nova-compute[70594]: iface.initiatorname = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.vlan_id = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.vlan_priority = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.vlan_state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.iface_num = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.mtu = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.port = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.bootproto = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.subnet_mask = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.gateway = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_alt_client_id_state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_alt_client_id = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_dns = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_learn_iqn = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_req_vendor_id_state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_vendor_id_state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_vendor_id = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.dhcp_slp_da = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.fragmentation = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.gratuitous_arp = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.incoming_forwarding = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.tos_state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.tos = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.ttl = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.delayed_ack = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.tcp_nagle = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.tcp_wsf_state = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.tcp_wsf = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.tcp_timer_scale = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.tcp_timestamp = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.redirect = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.def_task_mgmt_timeout = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.header_digest = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.data_digest = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.immediate_data = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.initial_r2t = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.data_seq_inorder = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.data_pdu_inorder = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.erl = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.max_receive_data_len = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.first_burst_len = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.max_outstanding_r2t = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.max_burst_len = 0
Jul 26 17:06:22 user nova-compute[70594]: iface.chap_auth = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.bidi_chap = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.strict_login_compliance = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.discovery_auth = <empty>
Jul 26 17:06:22 user nova-compute[70594]: iface.discovery_logout = <empty>
Jul 26 17:06:22 user nova-compute[70594]: node.discovery_address = <empty>
Jul 26 17:06:22 user nova-compute[70594]: node.discovery_port = 0
Jul 26 17:06:22 user nova-compute[70594]: node.discovery_type = static
Jul 26 17:06:22 user nova-compute[70594]: node.session.initial_cmdsn = 0
Jul 26 17:06:22 user nova-compute[70594]: node.session.initial_login_retry_max = 8
Jul 26 17:06:22 user nova-compute[70594]: node.session.xmit_thread_priority = -20
Jul 26 17:06:22 user nova-compute[70594]: node.session.cmds_max = 128
Jul 26 17:06:22 user nova-compute[70594]: node.session.queue_depth = 32
Jul 26 17:06:22 user nova-compute[70594]: node.session.nr_sessions = 1
Jul 26 17:06:22 user nova-compute[70594]: node.session.auth.authmethod = CHAP
Jul 26 17:06:22 user nova-compute[70594]: node.session.auth.username = rEjVCymI
Jul 26 17:06:22 user nova-compute[70594]: node.session.auth.password = ***
Jul 26 17:06:22 user nova-compute[70594]: node.session.auth.username_in = <empty>
Jul 26 17:06:22 user nova-compute[70594]: node.session.auth.password_in = <empty>
Jul 26 17:06:22 user nova-compute[70594]: node.session.auth.chap_algs = MD5
Jul 26 17:06:22 user nova-compute[70594]: node.session.timeo.replacement_timeout = 120
Jul 26 17:06:22 user nova-compute[70594]: node.session.err_timeo.abort_timeout = 15
Jul 26 17:06:22 user nova-compute[70594]: node.session.err_timeo.lu_reset_timeout = 30
Jul 26 17:06:22 user nova-compute[70594]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 26 17:06:22 user nova-compute[70594]: node.session.err_timeo.host_reset_timeout = 60
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.FastAbort = Yes
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.InitialR2T = No
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.ImmediateData = Yes
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.FirstBurstLength = 262144
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.MaxBurstLength = 16776192
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.DefaultTime2Retain = 0
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.DefaultTime2Wait = 2
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.MaxConnections = 1
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 26 17:06:22 user nova-compute[70594]: node.session.iscsi.ERL = 0
Jul 26 17:06:22 user nova-compute[70594]: node.session.scan = manual
Jul 26 17:06:22 user nova-compute[70594]: node.session.reopen_max = 0
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].address = 172.16.0.220
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].port = 3260
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].startup = manual
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].tcp.window_size = 524288
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].tcp.type_of_service = 0
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].timeo.logout_timeout = 15
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].timeo.login_timeout = 15
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].timeo.auth_timeout = 45
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].timeo.noop_out_interval = 5
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].timeo.noop_out_timeout = 5
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].iscsi.HeaderDigest = None
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].iscsi.DataDigest = None
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].iscsi.IFMarker = No
Jul 26 17:06:22 user nova-compute[70594]: node.conn[0].iscsi.OFMarker = No
Jul 26 17:06:22 user nova-compute[70594]: # END RECORD
Jul 26 17:06:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d06364-8c66-4e61-8e75-17d9028ad85f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08068692-21c3-4363-bb92-0c4b0d756f6d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjVCymI {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEjVCymI" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b693f6b-3c7b-4d65-b94b-c78d8efff224]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEjVCymI'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc47ebf-ab69-446c-95a0-30c4d958561d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74455d6-1524-4318-a781-6ee6d1815705]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)
Jul 26 17:06:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] HCTL ('33', '0', '0', 0) found on session 22 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ddfc7-732a-43c2-aba1-7fe54070e601]: (4, ('0 0 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching for a device in session 22 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '26465623134303863', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465623134303863', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-252829452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-252829452',id=21,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:04:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-0zmjpmej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:04:50Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=8ef02326-71b1-43ca-a53d-c2f73b049896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "vif_mac": "fa:16:3e:d4:b7:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "vif_mac": "fa:16:3e:d4:b7:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:06:22 user nova-compute[70594]:   <uuid>8ef02326-71b1-43ca-a53d-c2f73b049896</uuid>
Jul 26 17:06:22 user nova-compute[70594]:   <name>instance-00000015</name>
Jul 26 17:06:22 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:06:22 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:06:22 user nova-compute[70594]:   <metadata>
Jul 26 17:06:22 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:06:22 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:06:22 user nova-compute[70594]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-252829452</nova:name>
Jul 26 17:06:22 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:06:22</nova:creationTime>
Jul 26 17:06:22 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:06:22 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:06:22 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:06:22 user nova-compute[70594]:       <nova:owner>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:user uuid="f6af9ec8d9d644c89ba32c10861afba2">tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member</nova:user>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:project uuid="d253357a8f7b42119a7b91385afa0e8b">tempest-ServerBootFromVolumeStableRescueTest-43751456</nova:project>
Jul 26 17:06:22 user nova-compute[70594]:       </nova:owner>
Jul 26 17:06:22 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:06:22 user nova-compute[70594]:       <nova:ports>
Jul 26 17:06:22 user nova-compute[70594]:         <nova:port uuid="62446ba5-f54c-433c-91c2-b5f430eccc3a">
Jul 26 17:06:22 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 26 17:06:22 user nova-compute[70594]:         </nova:port>
Jul 26 17:06:22 user nova-compute[70594]:       </nova:ports>
Jul 26 17:06:22 user nova-compute[70594]:     </nova:instance>
Jul 26 17:06:22 user nova-compute[70594]:   </metadata>
Jul 26 17:06:22 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:06:22 user nova-compute[70594]:     <system>
Jul 26 17:06:22 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:06:22 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:06:22 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:06:22 user nova-compute[70594]:       <entry name="serial">8ef02326-71b1-43ca-a53d-c2f73b049896</entry>
Jul 26 17:06:22 user nova-compute[70594]:       <entry name="uuid">8ef02326-71b1-43ca-a53d-c2f73b049896</entry>
Jul 26 17:06:22 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:06:22 user nova-compute[70594]:     </system>
Jul 26 17:06:22 user nova-compute[70594]:   </sysinfo>
Jul 26 17:06:22 user nova-compute[70594]:   <os>
Jul 26 17:06:22 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:06:22 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:06:22 user nova-compute[70594]:   </os>
Jul 26 17:06:22 user nova-compute[70594]:   <features>
Jul 26 17:06:22 user nova-compute[70594]:     <acpi/>
Jul 26 17:06:22 user nova-compute[70594]:     <apic/>
Jul 26 17:06:22 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:06:22 user nova-compute[70594]:   </features>
Jul 26 17:06:22 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:06:22 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:06:22 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:06:22 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:06:22 user nova-compute[70594]:   </clock>
Jul 26 17:06:22 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:06:22 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:06:22 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:06:22 user nova-compute[70594]:   </cpu>
Jul 26 17:06:22 user nova-compute[70594]:   <devices>
Jul 26 17:06:22 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:06:22 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:06:22 user nova-compute[70594]:       <source dev="/dev/sdb"/>
Jul 26 17:06:22 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:06:22 user nova-compute[70594]:       <serial>55b56260-a269-4ce7-9398-b195ced9b560</serial>
Jul 26 17:06:22 user nova-compute[70594]:     </disk>
Jul 26 17:06:22 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:06:22 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:06:22 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue"/>
Jul 26 17:06:22 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:06:22 user nova-compute[70594]:       <boot order="1"/>
Jul 26 17:06:22 user nova-compute[70594]:     </disk>
Jul 26 17:06:22 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:06:22 user nova-compute[70594]:       <mac address="fa:16:3e:d4:b7:0b"/>
Jul 26 17:06:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:22 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:06:22 user nova-compute[70594]:       <target dev="tap62446ba5-f5"/>
Jul 26 17:06:22 user nova-compute[70594]:     </interface>
Jul 26 17:06:22 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:06:22 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/console.log" append="off"/>
Jul 26 17:06:22 user nova-compute[70594]:     </serial>
Jul 26 17:06:22 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:06:22 user nova-compute[70594]:     <video>
Jul 26 17:06:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:22 user nova-compute[70594]:     </video>
Jul 26 17:06:22 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:06:22 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:06:22 user nova-compute[70594]:     </rng>
Jul 26 17:06:22 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:06:22 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:06:22 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:06:22 user nova-compute[70594]:     </memballoon>
Jul 26 17:06:22 user nova-compute[70594]:   </devices>
Jul 26 17:06:22 user nova-compute[70594]: </domain>
Jul 26 17:06:22 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:06:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance destroyed successfully.
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No VIF found with MAC fa:16:3e:d4:b7:0b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:06:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-443bad26-303d-45a3-a881-f40bbf3e3374 req-258c0d46-eada-4e9b-9f33-6937752f63cc service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-443bad26-303d-45a3-a881-f40bbf3e3374 req-258c0d46-eada-4e9b-9f33-6937752f63cc service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-443bad26-303d-45a3-a881-f40bbf3e3374 req-258c0d46-eada-4e9b-9f33-6937752f63cc service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-443bad26-303d-45a3-a881-f40bbf3e3374 req-258c0d46-eada-4e9b-9f33-6937752f63cc service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-443bad26-303d-45a3-a881-f40bbf3e3374 req-258c0d46-eada-4e9b-9f33-6937752f63cc service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:24 user nova-compute[70594]: WARNING nova.compute.manager [req-443bad26-303d-45a3-a881-f40bbf3e3374 req-258c0d46-eada-4e9b-9f33-6937752f63cc service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state active and task_state rescuing.
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:25 user nova-compute[70594]: INFO nova.compute.manager [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Detaching volume 2420a3c9-493c-4fb4-a181-f026386f73a7
Jul 26 17:06:25 user nova-compute[70594]: INFO nova.virt.block_device [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Attempting to driver detach volume 2420a3c9-493c-4fb4-a181-f026386f73a7 from mountpoint /dev/vdb
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Attempting to detach device vdb from instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:06:25 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:06:25 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:06:25 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:06:25 user nova-compute[70594]:   <serial>2420a3c9-493c-4fb4-a181-f026386f73a7</serial>
Jul 26 17:06:25 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:06:25 user nova-compute[70594]: </disk>
Jul 26 17:06:25 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:06:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Successfully detached device vdb from instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 from the persistent domain config.
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:06:25 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:06:25 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:06:25 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:06:25 user nova-compute[70594]:   <serial>2420a3c9-493c-4fb4-a181-f026386f73a7</serial>
Jul 26 17:06:25 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:06:25 user nova-compute[70594]: </disk>
Jul 26 17:06:25 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing instance network info cache due to event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.network.neutron [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391185.875744, 6ac8029d-1df8-4648-979f-8f4fee7fdab4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:06:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Successfully detached device vdb from instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 from the live domain config.
Jul 26 17:06:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzKHWsDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:25 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16bf2d-5b94-433e-b3c8-403fc8abf96a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:06:25 user nova-compute[70594]: No targets found.
Jul 26 17:06:25 user nova-compute[70594]: iSNS:
Jul 26 17:06:25 user nova-compute[70594]: No targets found.
Jul 26 17:06:25 user nova-compute[70594]: STATIC:
Jul 26 17:06:25 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:06:25 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:25 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:25 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7
Jul 26 17:06:25 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:25 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:25 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad
Jul 26 17:06:25 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:25 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:25 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:06:25 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:25 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:25 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5
Jul 26 17:06:25 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:25 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:25 user nova-compute[70594]: FIRMWARE:
Jul 26 17:06:25 user nova-compute[70594]: No targets found.
Jul 26 17:06:25 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:06:25 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:06:25 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4795594-418b-47af-98fc-963269c9952c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc15ac-76e0-484c-b6fe-53a8c2e62b67]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 (non-flash)
Jul 26 17:06:25 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59104c6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7'): ({'sdf'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Removing single pathed devices sdf {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:06:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a856724b-2852-4a4f-816b-1bf294830e38]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773ec1a-a144-4d30-8c35-c3a1ad84517e]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Flushing IO for device /dev/sdf {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fde4b1-08ea-4de6-8fac-6a4391511269]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6be335-a0be-4dac-9bcc-6801e38db63e]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9f9c32-431e-4d90-af06-527530b3501a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[507fa220-d58f-4c04-9bd9-2936237ac6a1]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260]
Jul 26 17:06:26 user nova-compute[70594]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7, portal: 172.16.0.220,3260] successful.
Jul 26 17:06:26 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2420a3c9-493c-4fb4-a181-f026386f73a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[582d6460-db10-4aee-a8ca-7fc3f5973112]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] <== disconnect_volume: return (365ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 8ef02326-71b1-43ca-a53d-c2f73b049896 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391186.3700495, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:06:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Resumed (Lifecycle Event)
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-5e01f2c4-752c-47e6-b708-f8da146a65ba tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-62c59b6f-4cab-49bc-a352-c652389af6f6 req-69ed823b-5a00-43bd-a306-8350f6a2a770 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-62c59b6f-4cab-49bc-a352-c652389af6f6 req-69ed823b-5a00-43bd-a306-8350f6a2a770 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-62c59b6f-4cab-49bc-a352-c652389af6f6 req-69ed823b-5a00-43bd-a306-8350f6a2a770 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-62c59b6f-4cab-49bc-a352-c652389af6f6 req-69ed823b-5a00-43bd-a306-8350f6a2a770 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-62c59b6f-4cab-49bc-a352-c652389af6f6 req-69ed823b-5a00-43bd-a306-8350f6a2a770 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:26 user nova-compute[70594]: WARNING nova.compute.manager [req-62c59b6f-4cab-49bc-a352-c652389af6f6 req-69ed823b-5a00-43bd-a306-8350f6a2a770 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state active and task_state rescuing.
Jul 26 17:06:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391186.3715591, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:06:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Started (Lifecycle Event)
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updated VIF entry in instance network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b7f8760d-1a82-47cf-9ba2-0dca473cb568 req-1a4119c4-3a0c-4595-870c-347845bd9327 service nova] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lazy-loading 'flavor' on Instance uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1b372d3d-f8ed-4969-9fb2-984ca2c1789e tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.050s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:27 user nova-compute[70594]: INFO nova.compute.manager [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Detaching volume 72234be1-34b2-484c-b2f2-709fa1d72bad
Jul 26 17:06:27 user nova-compute[70594]: INFO nova.virt.block_device [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Attempting to driver detach volume 72234be1-34b2-484c-b2f2-709fa1d72bad from mountpoint /dev/vdb
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Attempting to detach device vdb from instance 76a02a97-4400-44d2-8655-89fc12f69682 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:06:27 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:06:27 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:06:27 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:06:27 user nova-compute[70594]:   <serial>72234be1-34b2-484c-b2f2-709fa1d72bad</serial>
Jul 26 17:06:27 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:06:27 user nova-compute[70594]: </disk>
Jul 26 17:06:27 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:06:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully detached device vdb from instance 76a02a97-4400-44d2-8655-89fc12f69682 from the persistent domain config.
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76a02a97-4400-44d2-8655-89fc12f69682 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:06:27 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:06:27 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:06:27 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:06:27 user nova-compute[70594]:   <serial>72234be1-34b2-484c-b2f2-709fa1d72bad</serial>
Jul 26 17:06:27 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:06:27 user nova-compute[70594]: </disk>
Jul 26 17:06:27 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing instance network info cache due to event network-changed-f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] Acquiring lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] Acquired lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Refreshing network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391188.3560812, 76a02a97-4400-44d2-8655-89fc12f69682 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:06:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully detached device vdb from instance 76a02a97-4400-44d2-8655-89fc12f69682 from the live domain config.
Jul 26 17:06:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFrXZDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[898f9611-6917-4274-8c0f-7f855ff81799]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:06:28 user nova-compute[70594]: No targets found.
Jul 26 17:06:28 user nova-compute[70594]: iSNS:
Jul 26 17:06:28 user nova-compute[70594]: No targets found.
Jul 26 17:06:28 user nova-compute[70594]: STATIC:
Jul 26 17:06:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:06:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad
Jul 26 17:06:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:06:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5
Jul 26 17:06:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:28 user nova-compute[70594]: FIRMWARE:
Jul 26 17:06:28 user nova-compute[70594]: No targets found.
Jul 26 17:06:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:06:28 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:06:28 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG nova.network.neutron [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updated VIF entry in instance network info cache for port f40ec4be-97e7-4bdf-a1aa-0be24286854b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG nova.network.neutron [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [{"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f85b7f4-9704-4b5c-9002-82f327c12ae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-71a141c5-8d95-433b-9309-eeef07e56020 req-b4bcf497-2589-4d6f-951b-9668e82ccc5d service nova] Releasing lock "refresh_cache-76a02a97-4400-44d2-8655-89fc12f69682" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a672e2e-c388-49d9-92d9-17ac4935bccb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:28 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:28 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:28 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:28 user nova-compute[70594]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad (non-flash)
Jul 26 17:06:28 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:28 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59102ea3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b65e31-c1cf-4da5-96d0-d37010b297f9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb3dc06-e9c9-4a64-8b8c-037e5c98ecc5]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e8a4a-a3c7-43b1-bd94-7becb794510f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4065ba41-6217-4f8b-ae48-dd6d28f17b92]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[def70688-30a2-43e3-8f0f-27a20ff4f823]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f459d-ec90-4d45-84f0-78ff57b770de]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260]
Jul 26 17:06:28 user nova-compute[70594]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad, portal: 172.16.0.220,3260] successful.
Jul 26 17:06:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72234be1-34b2-484c-b2f2-709fa1d72bad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f65a2-9539-40de-bd7b-93d02e680ab9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== disconnect_volume: return (348ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:06:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:29 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'flavor' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ef76de3-9cd6-4df2-bb29-70579c295f7f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.092s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:06:42 user nova-compute[70594]: INFO nova.compute.claims [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Claim successful on node user
Jul 26 17:06:42 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:06:42 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.network.neutron [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:06:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.policy [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c300fdc9bda48b1afdd00fbc5a6245e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0459f7d07ec54e3bbfe3915b2b7cfd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:06:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Creating image(s)
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk 1073741824" returned: 0 in 0.065s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Cannot resize image /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'migration_context' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.network.neutron [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Successfully created port: 5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Ensure instance console log exists: /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:06:45 user nova-compute[70594]: INFO nova.compute.claims [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Claim successful on node user
Jul 26 17:06:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Successfully updated port: 5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquired lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-changed-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Refreshing instance network info cache due to event network-changed-5ef9e468-621a-440e-8561-ab66e60d5b8b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] Acquiring lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:06:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:06:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:06:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Creating image(s)
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.policy [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5f5bd39056d4ebc973b6d8571a796ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2349e37642f4f4d9a3fe7b2c3d7a6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk 1073741824" returned: 0 in 0.064s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Releasing lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance network_info: |[{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] Acquired lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Refreshing network info cache for port 5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start _get_guest_xml network_info=[{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:06:46 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:46 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.objects.instance [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'pci_devices' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.228s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:06:46 user nova-compute[70594]:   <uuid>35205a75-e9a7-49a5-96f8-57631680ca05</uuid>
Jul 26 17:06:46 user nova-compute[70594]:   <name>instance-00000019</name>
Jul 26 17:06:46 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:06:46 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:06:46 user nova-compute[70594]:   <metadata>
Jul 26 17:06:46 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:06:46 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:06:46 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeTestJSON-server-1367667271</nova:name>
Jul 26 17:06:46 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:06:46</nova:creationTime>
Jul 26 17:06:46 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:06:46 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:06:46 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:06:46 user nova-compute[70594]:       <nova:owner>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:user uuid="5c300fdc9bda48b1afdd00fbc5a6245e">tempest-AttachVolumeTestJSON-35291756-project-member</nova:user>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:project uuid="0459f7d07ec54e3bbfe3915b2b7cfd7b">tempest-AttachVolumeTestJSON-35291756</nova:project>
Jul 26 17:06:46 user nova-compute[70594]:       </nova:owner>
Jul 26 17:06:46 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:06:46 user nova-compute[70594]:       <nova:ports>
Jul 26 17:06:46 user nova-compute[70594]:         <nova:port uuid="5ef9e468-621a-440e-8561-ab66e60d5b8b">
Jul 26 17:06:46 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:06:46 user nova-compute[70594]:         </nova:port>
Jul 26 17:06:46 user nova-compute[70594]:       </nova:ports>
Jul 26 17:06:46 user nova-compute[70594]:     </nova:instance>
Jul 26 17:06:46 user nova-compute[70594]:   </metadata>
Jul 26 17:06:46 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:06:46 user nova-compute[70594]:     <system>
Jul 26 17:06:46 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:06:46 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:06:46 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:06:46 user nova-compute[70594]:       <entry name="serial">35205a75-e9a7-49a5-96f8-57631680ca05</entry>
Jul 26 17:06:46 user nova-compute[70594]:       <entry name="uuid">35205a75-e9a7-49a5-96f8-57631680ca05</entry>
Jul 26 17:06:46 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:06:46 user nova-compute[70594]:     </system>
Jul 26 17:06:46 user nova-compute[70594]:   </sysinfo>
Jul 26 17:06:46 user nova-compute[70594]:   <os>
Jul 26 17:06:46 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:06:46 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:06:46 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:06:46 user nova-compute[70594]:   </os>
Jul 26 17:06:46 user nova-compute[70594]:   <features>
Jul 26 17:06:46 user nova-compute[70594]:     <acpi/>
Jul 26 17:06:46 user nova-compute[70594]:     <apic/>
Jul 26 17:06:46 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:06:46 user nova-compute[70594]:   </features>
Jul 26 17:06:46 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:06:46 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:06:46 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:06:46 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:06:46 user nova-compute[70594]:   </clock>
Jul 26 17:06:46 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:06:46 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:06:46 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:06:46 user nova-compute[70594]:   </cpu>
Jul 26 17:06:46 user nova-compute[70594]:   <devices>
Jul 26 17:06:46 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:06:46 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:06:46 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk"/>
Jul 26 17:06:46 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:06:46 user nova-compute[70594]:     </disk>
Jul 26 17:06:46 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:06:46 user nova-compute[70594]:       <mac address="fa:16:3e:36:f4:ab"/>
Jul 26 17:06:46 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:46 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:06:46 user nova-compute[70594]:       <target dev="tap5ef9e468-62"/>
Jul 26 17:06:46 user nova-compute[70594]:     </interface>
Jul 26 17:06:46 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:06:46 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/console.log" append="off"/>
Jul 26 17:06:46 user nova-compute[70594]:     </serial>
Jul 26 17:06:46 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:06:46 user nova-compute[70594]:     <video>
Jul 26 17:06:46 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:46 user nova-compute[70594]:     </video>
Jul 26 17:06:46 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:06:46 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:06:46 user nova-compute[70594]:     </rng>
Jul 26 17:06:46 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:06:46 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:06:46 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:06:46 user nova-compute[70594]:     </memballoon>
Jul 26 17:06:46 user nova-compute[70594]:   </devices>
Jul 26 17:06:46 user nova-compute[70594]: </domain>
Jul 26 17:06:46 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG os_vif [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef9e468-62, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ef9e468-62, col_values=(('external_ids', {'iface-id': '5ef9e468-621a-440e-8561-ab66e60d5b8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f4:ab', 'vm-uuid': '35205a75-e9a7-49a5-96f8-57631680ca05'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:06:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:46 user nova-compute[70594]: INFO os_vif [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62')
Jul 26 17:06:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Cannot resize image /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'migration_context' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Ensure instance console log exists: /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No VIF found with MAC fa:16:3e:36:f4:ab, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updated VIF entry in instance network info cache for port 5ef9e468-621a-440e-8561-ab66e60d5b8b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-616d1551-bebd-4526-88e2-800aafc427b0 req-e4619088-2612-4ecb-b598-ba899b3e5a18 service nova] Releasing lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Successfully created port: 0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-changed-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Refreshing instance network info cache due to event network-changed-f21510ad-d95a-446c-af00-d2ec1a59754e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] Acquiring lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] Acquired lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Refreshing network info cache for port f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-9aca8f8b-3bc3-40ab-8ad3-6138e2972138 req-694d269d-f663-4d93-9618-bb4d436833e0 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9aca8f8b-3bc3-40ab-8ad3-6138e2972138 req-694d269d-f663-4d93-9618-bb4d436833e0 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9aca8f8b-3bc3-40ab-8ad3-6138e2972138 req-694d269d-f663-4d93-9618-bb4d436833e0 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9aca8f8b-3bc3-40ab-8ad3-6138e2972138 req-694d269d-f663-4d93-9618-bb4d436833e0 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-9aca8f8b-3bc3-40ab-8ad3-6138e2972138 req-694d269d-f663-4d93-9618-bb4d436833e0 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:48 user nova-compute[70594]: WARNING nova.compute.manager [req-9aca8f8b-3bc3-40ab-8ad3-6138e2972138 req-694d269d-f663-4d93-9618-bb4d436833e0 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state building and task_state spawning.
Jul 26 17:06:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updated VIF entry in instance network info cache for port f21510ad-d95a-446c-af00-d2ec1a59754e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updating instance_info_cache with network_info: [{"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:50 user nova-compute[70594]: INFO nova.compute.manager [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Rebuilding instance
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d74e36e-e1ef-4969-a7e2-c32b3f5c0147 req-10bc82b4-1294-4531-8d6d-d15bd35e703d service nova] Releasing lock "refresh_cache-fc2f6a06-3514-44fb-9391-fce3c1182e27" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'pci_requests' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'resources' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'migration_context' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70594) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-69697897-54a8-4d9c-ac1e-89afd0631ec4 req-f64ae446-79a8-4543-b9a5-4e326861724c service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-69697897-54a8-4d9c-ac1e-89afd0631ec4 req-f64ae446-79a8-4543-b9a5-4e326861724c service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-69697897-54a8-4d9c-ac1e-89afd0631ec4 req-f64ae446-79a8-4543-b9a5-4e326861724c service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-69697897-54a8-4d9c-ac1e-89afd0631ec4 req-f64ae446-79a8-4543-b9a5-4e326861724c service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-69697897-54a8-4d9c-ac1e-89afd0631ec4 req-f64ae446-79a8-4543-b9a5-4e326861724c service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:50 user nova-compute[70594]: WARNING nova.compute.manager [req-69697897-54a8-4d9c-ac1e-89afd0631ec4 req-f64ae446-79a8-4543-b9a5-4e326861724c service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state building and task_state spawning.
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Successfully updated port: 0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-d49650f0-cb4d-4106-90bc-d35212a9e1d2 req-2083de42-c638-41a7-af05-4d8edf27b0de service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-unplugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d49650f0-cb4d-4106-90bc-d35212a9e1d2 req-2083de42-c638-41a7-af05-4d8edf27b0de service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d49650f0-cb4d-4106-90bc-d35212a9e1d2 req-2083de42-c638-41a7-af05-4d8edf27b0de service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d49650f0-cb4d-4106-90bc-d35212a9e1d2 req-2083de42-c638-41a7-af05-4d8edf27b0de service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-d49650f0-cb4d-4106-90bc-d35212a9e1d2 req-2083de42-c638-41a7-af05-4d8edf27b0de service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-unplugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:50 user nova-compute[70594]: WARNING nova.compute.manager [req-d49650f0-cb4d-4106-90bc-d35212a9e1d2 req-2083de42-c638-41a7-af05-4d8edf27b0de service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-unplugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state active and task_state rebuilding.
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391210.937752, 35205a75-e9a7-49a5-96f8-57631680ca05 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:06:50 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Resumed (Lifecycle Event)
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:06:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance spawned successfully.
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:06:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391210.9380388, 35205a75-e9a7-49a5-96f8-57631680ca05 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Started (Lifecycle Event)
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance destroyed successfully.
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance destroyed successfully.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88264397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-180134213',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEcRpCH5inq5cCtNWGZ0sP8y/LsMiqplLE8iHhed0eAKEyo6FWVuTdfDcFiP4qVJUCdHqt6pEGOStBDb13bq3q9WqN+RbObuu/4z6fq21wNlTLOSGkHBxLbST6DOWgonQ==',key_name='tempest-keypair-1106897005',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-hq0pmkvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=fc2f6a06-3514-44fb-9391-fce3c1182e27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf21510ad-d9, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:06:51 user nova-compute[70594]: INFO os_vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9')
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Took 7.89 seconds to spawn the instance on the hypervisor.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5180b9d-9252-4be0-8c8d-62f7053864e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:06:51 user nova-compute[70594]: No targets found.
Jul 26 17:06:51 user nova-compute[70594]: iSNS:
Jul 26 17:06:51 user nova-compute[70594]: No targets found.
Jul 26 17:06:51 user nova-compute[70594]: STATIC:
Jul 26 17:06:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:06:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:06:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5
Jul 26 17:06:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:51 user nova-compute[70594]: FIRMWARE:
Jul 26 17:06:51 user nova-compute[70594]: No targets found.
Jul 26 17:06:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:06:51 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:06:51 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc92de46-28e3-4267-93ab-5d734b8d4859]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68d0d6-305d-41b3-a3fb-d162c0e2dc53]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:51 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:51 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:51 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:51 user nova-compute[70594]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:06:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910175630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.compute.manager [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Took 8.80 seconds to build instance.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a53592e-b0b0-4a49-a7f6-79d99ab579b4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-20d9936d-977d-4784-ad64-4bcb3d271f95 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.903s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5649b-cd2a-428a-8344-fdc3899aeb2c]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d8872-b2bd-4835-884b-eb5585b050f6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea5f642-3dd5-4c18-a296-4431ede22a9a]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23164313261313634', '/dev/disk/by-id/scsi-1SCST_BIOaea77f31-1d12a16423d21b53', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aea77f31') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59fadd-c004-4a5b-b05c-d624ebef72aa]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a62f439-4a06-4a89-b9da-cc028b77bb72]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadcc37a-37a6-45bf-9d4c-6cc40867589a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]
Jul 26 17:06:51 user nova-compute[70594]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.
Jul 26 17:06:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e826a0-6c55-49ea-93f5-c69c11755137]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== disconnect_volume: return (412ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Deleting instance files /opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27_del
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Deletion of /opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27_del complete
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:06:51 user nova-compute[70594]: INFO nova.compute.claims [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Claim successful on node user
Jul 26 17:06:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance fc2f6a06-3514-44fb-9391-fce3c1182e27 could not be found.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance network_info: |[{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Start _get_guest_xml network_info=[{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:06:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3dd8a5-b182-4f4b-92da-d2983bde7b5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:06:51 user nova-compute[70594]: No targets found.
Jul 26 17:06:51 user nova-compute[70594]: iSNS:
Jul 26 17:06:51 user nova-compute[70594]: No targets found.
Jul 26 17:06:51 user nova-compute[70594]: STATIC:
Jul 26 17:06:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:06:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:06:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:51 user nova-compute[70594]: FIRMWARE:
Jul 26 17:06:51 user nova-compute[70594]: No targets found.
Jul 26 17:06:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:06:51 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:06:51 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-694281953',display_name='tempest-ServerRescueNegativeTestJSON-server-694281953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-694281953',id=26,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQyJw0+WuVC0dgS0L/dqS9Dx4JJ2YwhAgW8IpMVHEBgdmvIUcPFFddQF0iy5DrmLHXPWnbgRkKCOsxhvZyj/aID8CPZlV2RtBC39OTqabWPER9Yz3kSw+9xTF0CZEyF8Q==',key_name='tempest-keypair-268226951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-adcayqe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=9c7ad527-efb9-4cec-8791-010b7a28eab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec78d5-3fee-4144-b2eb-4d708c034ac3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:06:51 user nova-compute[70594]:   <uuid>9c7ad527-efb9-4cec-8791-010b7a28eab5</uuid>
Jul 26 17:06:51 user nova-compute[70594]:   <name>instance-0000001a</name>
Jul 26 17:06:51 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:06:51 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:06:51 user nova-compute[70594]:   <metadata>
Jul 26 17:06:51 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:06:51 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:06:51 user nova-compute[70594]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-694281953</nova:name>
Jul 26 17:06:51 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:06:51</nova:creationTime>
Jul 26 17:06:51 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:06:51 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:06:51 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:06:51 user nova-compute[70594]:       <nova:owner>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:user uuid="f5f5bd39056d4ebc973b6d8571a796ab">tempest-ServerRescueNegativeTestJSON-159727237-project-member</nova:user>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:project uuid="a2349e37642f4f4d9a3fe7b2c3d7a6c7">tempest-ServerRescueNegativeTestJSON-159727237</nova:project>
Jul 26 17:06:51 user nova-compute[70594]:       </nova:owner>
Jul 26 17:06:51 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:06:51 user nova-compute[70594]:       <nova:ports>
Jul 26 17:06:51 user nova-compute[70594]:         <nova:port uuid="0106bf37-b840-4629-81e8-a1df185a2cc2">
Jul 26 17:06:51 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:06:51 user nova-compute[70594]:         </nova:port>
Jul 26 17:06:51 user nova-compute[70594]:       </nova:ports>
Jul 26 17:06:51 user nova-compute[70594]:     </nova:instance>
Jul 26 17:06:51 user nova-compute[70594]:   </metadata>
Jul 26 17:06:51 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:06:51 user nova-compute[70594]:     <system>
Jul 26 17:06:51 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:06:51 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:06:51 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:06:51 user nova-compute[70594]:       <entry name="serial">9c7ad527-efb9-4cec-8791-010b7a28eab5</entry>
Jul 26 17:06:51 user nova-compute[70594]:       <entry name="uuid">9c7ad527-efb9-4cec-8791-010b7a28eab5</entry>
Jul 26 17:06:51 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:06:51 user nova-compute[70594]:     </system>
Jul 26 17:06:51 user nova-compute[70594]:   </sysinfo>
Jul 26 17:06:51 user nova-compute[70594]:   <os>
Jul 26 17:06:51 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:06:51 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:06:51 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:06:51 user nova-compute[70594]:   </os>
Jul 26 17:06:51 user nova-compute[70594]:   <features>
Jul 26 17:06:51 user nova-compute[70594]:     <acpi/>
Jul 26 17:06:51 user nova-compute[70594]:     <apic/>
Jul 26 17:06:51 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:06:51 user nova-compute[70594]:   </features>
Jul 26 17:06:51 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:06:51 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:06:51 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:06:51 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:06:51 user nova-compute[70594]:   </clock>
Jul 26 17:06:51 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:06:51 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:06:51 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:06:51 user nova-compute[70594]:   </cpu>
Jul 26 17:06:51 user nova-compute[70594]:   <devices>
Jul 26 17:06:51 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:06:51 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:06:51 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk"/>
Jul 26 17:06:51 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:06:51 user nova-compute[70594]:     </disk>
Jul 26 17:06:51 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:06:51 user nova-compute[70594]:       <mac address="fa:16:3e:b7:d6:90"/>
Jul 26 17:06:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:51 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:06:51 user nova-compute[70594]:       <target dev="tap0106bf37-b8"/>
Jul 26 17:06:51 user nova-compute[70594]:     </interface>
Jul 26 17:06:51 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:06:51 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/console.log" append="off"/>
Jul 26 17:06:51 user nova-compute[70594]:     </serial>
Jul 26 17:06:51 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:06:51 user nova-compute[70594]:     <video>
Jul 26 17:06:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:51 user nova-compute[70594]:     </video>
Jul 26 17:06:51 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:06:51 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:06:51 user nova-compute[70594]:     </rng>
Jul 26 17:06:51 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:06:51 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:06:51 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:06:51 user nova-compute[70594]:     </memballoon>
Jul 26 17:06:51 user nova-compute[70594]:   </devices>
Jul 26 17:06:51 user nova-compute[70594]: </domain>
Jul 26 17:06:51 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-694281953',display_name='tempest-ServerRescueNegativeTestJSON-server-694281953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-694281953',id=26,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQyJw0+WuVC0dgS0L/dqS9Dx4JJ2YwhAgW8IpMVHEBgdmvIUcPFFddQF0iy5DrmLHXPWnbgRkKCOsxhvZyj/aID8CPZlV2RtBC39OTqabWPER9Yz3kSw+9xTF0CZEyF8Q==',key_name='tempest-keypair-268226951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-adcayqe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=9c7ad527-efb9-4cec-8791-010b7a28eab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG os_vif [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0106bf37-b8, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0106bf37-b8, col_values=(('external_ids', {'iface-id': '0106bf37-b840-4629-81e8-a1df185a2cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d6:90', 'vm-uuid': '9c7ad527-efb9-4cec-8791-010b7a28eab5'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d83a1e-3c42-4202-ae47-acc6a9b0fffa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:52 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:52 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59006e1090>, {}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Disconnecting from: [] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.167s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== disconnect_volume: return (168ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:06:52 user nova-compute[70594]: INFO os_vif [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8')
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:b7:d6:90, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.network.neutron [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:06:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.policy [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feffa97fa65d4c2e963c6ef550377550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cf13ef41474309a9651baab74f6903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:06:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Creating image(s)
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing instance network info cache due to event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.172s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk 1073741824" returned: 0 in 0.061s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Cannot resize image /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.objects.instance [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'migration_context' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Ensure instance console log exists: /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updated VIF entry in instance network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:53 user nova-compute[70594]: WARNING nova.compute.manager [req-eb0ecb09-1681-42e5-bf1e-dceefdc91689 req-2733306f-af00-48b1-8bfa-907d36546b53 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state active and task_state rebuilding.
Jul 26 17:06:53 user nova-compute[70594]: DEBUG nova.network.neutron [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Successfully created port: fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-2d5a36c7-6e87-4fd8-9c68-6c2516afe3ea req-dd0a095e-3c52-4124-a947-98f0247a9596 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2d5a36c7-6e87-4fd8-9c68-6c2516afe3ea req-dd0a095e-3c52-4124-a947-98f0247a9596 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2d5a36c7-6e87-4fd8-9c68-6c2516afe3ea req-dd0a095e-3c52-4124-a947-98f0247a9596 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2d5a36c7-6e87-4fd8-9c68-6c2516afe3ea req-dd0a095e-3c52-4124-a947-98f0247a9596 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-2d5a36c7-6e87-4fd8-9c68-6c2516afe3ea req-dd0a095e-3c52-4124-a947-98f0247a9596 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:54 user nova-compute[70594]: WARNING nova.compute.manager [req-2d5a36c7-6e87-4fd8-9c68-6c2516afe3ea req-dd0a095e-3c52-4124-a947-98f0247a9596 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state building and task_state spawning.
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Successfully updated port: fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquired lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-changed-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Refreshing instance network info cache due to event network-changed-fd093a50-c11a-4ba5-b451-63176c04f7a8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] Acquiring lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.neutron [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Releasing lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance network_info: |[{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] Acquired lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.neutron [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Refreshing network info cache for port fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Start _get_guest_xml network_info=[{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:06:55 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:55 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-183510375',display_name='tempest-ServerActionsTestOtherA-server-183510375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-183510375',id=27,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-okf8hylx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=6bd16164-caa5-442a-b55c-f84119c36256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:06:55 user nova-compute[70594]:   <uuid>6bd16164-caa5-442a-b55c-f84119c36256</uuid>
Jul 26 17:06:55 user nova-compute[70594]:   <name>instance-0000001b</name>
Jul 26 17:06:55 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:06:55 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:06:55 user nova-compute[70594]:   <metadata>
Jul 26 17:06:55 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:06:55 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:06:55 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherA-server-183510375</nova:name>
Jul 26 17:06:55 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:06:55</nova:creationTime>
Jul 26 17:06:55 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:06:55 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:06:55 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:06:55 user nova-compute[70594]:       <nova:owner>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:user uuid="feffa97fa65d4c2e963c6ef550377550">tempest-ServerActionsTestOtherA-1622849011-project-member</nova:user>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:project uuid="a4cf13ef41474309a9651baab74f6903">tempest-ServerActionsTestOtherA-1622849011</nova:project>
Jul 26 17:06:55 user nova-compute[70594]:       </nova:owner>
Jul 26 17:06:55 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:06:55 user nova-compute[70594]:       <nova:ports>
Jul 26 17:06:55 user nova-compute[70594]:         <nova:port uuid="fd093a50-c11a-4ba5-b451-63176c04f7a8">
Jul 26 17:06:55 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:06:55 user nova-compute[70594]:         </nova:port>
Jul 26 17:06:55 user nova-compute[70594]:       </nova:ports>
Jul 26 17:06:55 user nova-compute[70594]:     </nova:instance>
Jul 26 17:06:55 user nova-compute[70594]:   </metadata>
Jul 26 17:06:55 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:06:55 user nova-compute[70594]:     <system>
Jul 26 17:06:55 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:06:55 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:06:55 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:06:55 user nova-compute[70594]:       <entry name="serial">6bd16164-caa5-442a-b55c-f84119c36256</entry>
Jul 26 17:06:55 user nova-compute[70594]:       <entry name="uuid">6bd16164-caa5-442a-b55c-f84119c36256</entry>
Jul 26 17:06:55 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:06:55 user nova-compute[70594]:     </system>
Jul 26 17:06:55 user nova-compute[70594]:   </sysinfo>
Jul 26 17:06:55 user nova-compute[70594]:   <os>
Jul 26 17:06:55 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:06:55 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:06:55 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:06:55 user nova-compute[70594]:   </os>
Jul 26 17:06:55 user nova-compute[70594]:   <features>
Jul 26 17:06:55 user nova-compute[70594]:     <acpi/>
Jul 26 17:06:55 user nova-compute[70594]:     <apic/>
Jul 26 17:06:55 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:06:55 user nova-compute[70594]:   </features>
Jul 26 17:06:55 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:06:55 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:06:55 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:06:55 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:06:55 user nova-compute[70594]:   </clock>
Jul 26 17:06:55 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:06:55 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:06:55 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:06:55 user nova-compute[70594]:   </cpu>
Jul 26 17:06:55 user nova-compute[70594]:   <devices>
Jul 26 17:06:55 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:06:55 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:06:55 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk"/>
Jul 26 17:06:55 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:06:55 user nova-compute[70594]:     </disk>
Jul 26 17:06:55 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:06:55 user nova-compute[70594]:       <mac address="fa:16:3e:5e:43:0c"/>
Jul 26 17:06:55 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:55 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:06:55 user nova-compute[70594]:       <target dev="tapfd093a50-c1"/>
Jul 26 17:06:55 user nova-compute[70594]:     </interface>
Jul 26 17:06:55 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:06:55 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/console.log" append="off"/>
Jul 26 17:06:55 user nova-compute[70594]:     </serial>
Jul 26 17:06:55 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:06:55 user nova-compute[70594]:     <video>
Jul 26 17:06:55 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:06:55 user nova-compute[70594]:     </video>
Jul 26 17:06:55 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:06:55 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:06:55 user nova-compute[70594]:     </rng>
Jul 26 17:06:55 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:06:55 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:06:55 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:06:55 user nova-compute[70594]:     </memballoon>
Jul 26 17:06:55 user nova-compute[70594]:   </devices>
Jul 26 17:06:55 user nova-compute[70594]: </domain>
Jul 26 17:06:55 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-183510375',display_name='tempest-ServerActionsTestOtherA-server-183510375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-183510375',id=27,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-okf8hylx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=6bd16164-caa5-442a-b55c-f84119c36256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG os_vif [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd093a50-c1, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd093a50-c1, col_values=(('external_ids', {'iface-id': 'fd093a50-c11a-4ba5-b451-63176c04f7a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:43:0c', 'vm-uuid': '6bd16164-caa5-442a-b55c-f84119c36256'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:55 user nova-compute[70594]: INFO os_vif [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1')
Jul 26 17:06:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No VIF found with MAC fa:16:3e:5e:43:0c, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:55 user nova-compute[70594]: INFO nova.compute.manager [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Terminating instance
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Preparing to wait for external event volume-reimaged-97b1271d-393d-49d8-9a17-cb7018f78fa5 {{(pid=70594) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-2066092c-6ab4-468d-9db5-7d68cf5e4b1e req-a8d566a2-560a-4fce-ab0c-bd8e01a8cfa1 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2066092c-6ab4-468d-9db5-7d68cf5e4b1e req-a8d566a2-560a-4fce-ab0c-bd8e01a8cfa1 service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2066092c-6ab4-468d-9db5-7d68cf5e4b1e req-a8d566a2-560a-4fce-ab0c-bd8e01a8cfa1 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2066092c-6ab4-468d-9db5-7d68cf5e4b1e req-a8d566a2-560a-4fce-ab0c-bd8e01a8cfa1 service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-2066092c-6ab4-468d-9db5-7d68cf5e4b1e req-a8d566a2-560a-4fce-ab0c-bd8e01a8cfa1 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-2066092c-6ab4-468d-9db5-7d68cf5e4b1e req-a8d566a2-560a-4fce-ab0c-bd8e01a8cfa1 service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-unplugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.network.neutron [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updated VIF entry in instance network info cache for port fd093a50-c11a-4ba5-b451-63176c04f7a8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.network.neutron [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6827ac91-5068-4eff-a393-bfaa80db405c req-59447138-67de-4110-ab17-59f2ddcb04f9 service nova] Releasing lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-8f2fc392-590c-4e57-bb50-fa74de4084c9 req-2a04f8ef-3832-4b85-a3ca-d5b1a6ccc148 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8f2fc392-590c-4e57-bb50-fa74de4084c9 req-2a04f8ef-3832-4b85-a3ca-d5b1a6ccc148 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8f2fc392-590c-4e57-bb50-fa74de4084c9 req-2a04f8ef-3832-4b85-a3ca-d5b1a6ccc148 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8f2fc392-590c-4e57-bb50-fa74de4084c9 req-2a04f8ef-3832-4b85-a3ca-d5b1a6ccc148 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-8f2fc392-590c-4e57-bb50-fa74de4084c9 req-2a04f8ef-3832-4b85-a3ca-d5b1a6ccc148 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:56 user nova-compute[70594]: WARNING nova.compute.manager [req-8f2fc392-590c-4e57-bb50-fa74de4084c9 req-2a04f8ef-3832-4b85-a3ca-d5b1a6ccc148 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state building and task_state spawning.
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391216.7864716, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:06:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Resumed (Lifecycle Event)
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance spawned successfully.
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:06:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391216.7926533, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:06:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Started (Lifecycle Event)
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:06:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:06:56 user nova-compute[70594]: INFO nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Took 10.73 seconds to spawn the instance on the hypervisor.
Jul 26 17:06:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:06:57 user nova-compute[70594]: INFO nova.compute.manager [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Took 11.76 seconds to build instance.
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-299b06ff-a653-4616-b0a9-e29adc8b8d47 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.891s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Instance destroyed successfully.
Jul 26 17:06:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lazy-loading 'resources' on Instance uuid a624beaa-5c38-4aee-9c04-4e888e85f0f9 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-478314950',display_name='tempest-ServerActionsTestOtherB-server-478314950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-478314950',id=6,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2IqWxJTX52BIdihtvP9ktEn8d0B95uXE+D7tsid/ixMNqLbO/DRn8+pswRHh5Bl2Bhu5Xk6LHSRZd5cDLx6hItD1FDblfTGHx8/HG48E1eRaT6Ujayuags1YO2hkm6FA==',key_name='tempest-keypair-1261930939',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:04:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd171f41764f60b8abe257e5f6e2c2',ramdisk_id='',reservation_id='r-75mtxgef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1823585199',owner_user_name='tempest-ServerActionsTestOtherB-1823585199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43c125b2ba334237878f2c655fed828a',uuid=a624beaa-5c38-4aee-9c04-4e888e85f0f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converting VIF {"id": "87faecb4-e13b-455f-911b-2c9f9e614336", "address": "fa:16:3e:be:a5:cb", "network": {"id": "3cd6f833-c3da-431f-a71c-dd1b47806344", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-101219853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd171f41764f60b8abe257e5f6e2c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87faecb4-e1", "ovs_interfaceid": "87faecb4-e13b-455f-911b-2c9f9e614336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_vif [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87faecb4-e1, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:57 user nova-compute[70594]: INFO os_vif [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a5:cb,bridge_name='br-int',has_traffic_filtering=True,id=87faecb4-e13b-455f-911b-2c9f9e614336,network=Network(3cd6f833-c3da-431f-a71c-dd1b47806344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87faecb4-e1')
Jul 26 17:06:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdcHDxBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:06:57 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[140e748e-e149-4c9d-a41c-b82293d366d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:06:57 user nova-compute[70594]: No targets found.
Jul 26 17:06:57 user nova-compute[70594]: iSNS:
Jul 26 17:06:57 user nova-compute[70594]: No targets found.
Jul 26 17:06:57 user nova-compute[70594]: STATIC:
Jul 26 17:06:57 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:06:57 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:57 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:57 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9
Jul 26 17:06:57 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:06:57 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:06:57 user nova-compute[70594]: FIRMWARE:
Jul 26 17:06:57 user nova-compute[70594]: No targets found.
Jul 26 17:06:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:06:57 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:06:57 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4376ae-2176-4a45-89a9-d5e31272cfc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e951ecc-08b8-441d-b8c3-5ebcc27c0a05]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:57 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 (non-flash)
Jul 26 17:06:57 user nova-compute[70594]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:06:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910257640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dafbdc-7076-4d50-99e9-2d70451a61d1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d4f3f2-94a8-4c97-a8e0-109bcafefda5]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b736a1e2-655e-48ff-8f2f-799368794200]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9d7676-74bb-4edb-9e89-07c261d43ff7]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba696c01-988c-4700-a1ad-82e02f4f01f3]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208162b-2f8a-40b6-b707-50d43258dcc3]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260]
Jul 26 17:06:57 user nova-compute[70594]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9, portal: 172.16.0.220,3260] successful.
Jul 26 17:06:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa9af32a-f17c-4993-b3b2-9b1e89a6aac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9d805-0555-45b7-9213-4a615767d953]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] <== disconnect_volume: return (402ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:06:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:06:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Deleting instance files /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9_del
Jul 26 17:06:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Deletion of /opt/stack/data/nova/instances/a624beaa-5c38-4aee-9c04-4e888e85f0f9_del complete
Jul 26 17:06:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:58 user nova-compute[70594]: INFO nova.compute.manager [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Took 2.21 seconds to destroy the instance on the hypervisor.
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] Acquiring lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] No waiting events found dispatching network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:58 user nova-compute[70594]: WARNING nova.compute.manager [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received unexpected event network-vif-plugged-87faecb4-e13b-455f-911b-2c9f9e614336 for instance with vm_state active and task_state deleting.
Jul 26 17:06:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:06:58 user nova-compute[70594]: WARNING nova.compute.manager [req-fd708620-6290-4fd1-b912-67fb2df41753 req-702808ce-e602-4caa-b61e-1ae217579e8d service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state building and task_state spawning.
Jul 26 17:06:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:06:58 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:06:59 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:06:59 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Took 1.23 seconds to deallocate network for instance.
Jul 26 17:06:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-865a31a5-d41d-490c-b7f1-0cba563f2bc6 req-54b25920-493a-4c9c-98f0-4d1ca6c893ca service nova] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Received event network-vif-deleted-87faecb4-e13b-455f-911b-2c9f9e614336 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Took 0.88 seconds to detach 1 volumes for instance.
Jul 26 17:07:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-2fbb020f-773b-4e8b-b477-5395b18557f1 req-64e4144e-4885-488e-82b8-5e3ab7d06144 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2fbb020f-773b-4e8b-b477-5395b18557f1 req-64e4144e-4885-488e-82b8-5e3ab7d06144 service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2fbb020f-773b-4e8b-b477-5395b18557f1 req-64e4144e-4885-488e-82b8-5e3ab7d06144 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2fbb020f-773b-4e8b-b477-5395b18557f1 req-64e4144e-4885-488e-82b8-5e3ab7d06144 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-2fbb020f-773b-4e8b-b477-5395b18557f1 req-64e4144e-4885-488e-82b8-5e3ab7d06144 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:00 user nova-compute[70594]: WARNING nova.compute.manager [req-2fbb020f-773b-4e8b-b477-5395b18557f1 req-64e4144e-4885-488e-82b8-5e3ab7d06144 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state building and task_state spawning.
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391220.6635568, 6bd16164-caa5-442a-b55c-f84119c36256 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] VM Resumed (Lifecycle Event)
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance spawned successfully.
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391220.6648154, 6bd16164-caa5-442a-b55c-f84119c36256 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] VM Started (Lifecycle Event)
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Took 8.07 seconds to spawn the instance on the hypervisor.
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.compute.manager [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Took 9.24 seconds to build instance.
Jul 26 17:07:00 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Deleted allocations for instance a624beaa-5c38-4aee-9c04-4e888e85f0f9
Jul 26 17:07:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00930c70-2244-410a-8081-f6b0e669adbf tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.404s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-6b4b7b03-5dd3-4b18-842b-7d631efc6ed8 tempest-ServerActionsTestOtherB-1823585199 tempest-ServerActionsTestOtherB-1823585199-project-member] Lock "a624beaa-5c38-4aee-9c04-4e888e85f0f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.368s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:01 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:02 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "6be14a61-4040-441b-ad4c-7ec97285c610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:04 user nova-compute[70594]: INFO nova.compute.manager [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Terminating instance
Jul 26 17:07:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:07:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-648b999b-52e4-4031-a2a1-8b232f97ff28 req-53dd522a-2aaa-46b1-abb1-3fa110303746 service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-vif-unplugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-648b999b-52e4-4031-a2a1-8b232f97ff28 req-53dd522a-2aaa-46b1-abb1-3fa110303746 service nova] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-648b999b-52e4-4031-a2a1-8b232f97ff28 req-53dd522a-2aaa-46b1-abb1-3fa110303746 service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-648b999b-52e4-4031-a2a1-8b232f97ff28 req-53dd522a-2aaa-46b1-abb1-3fa110303746 service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-648b999b-52e4-4031-a2a1-8b232f97ff28 req-53dd522a-2aaa-46b1-abb1-3fa110303746 service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] No waiting events found dispatching network-vif-unplugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-648b999b-52e4-4031-a2a1-8b232f97ff28 req-53dd522a-2aaa-46b1-abb1-3fa110303746 service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-vif-unplugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:05 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Instance destroyed successfully.
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lazy-loading 'resources' on Instance uuid 6be14a61-4040-441b-ad4c-7ec97285c610 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-28898448',display_name='tempest-VolumesActionsTest-instance-28898448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-28898448',id=23,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='283afd57674e453b8a19d978ada8790a',ramdisk_id='',reservation_id='r-9xli5ary',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-642530868',owner_user_name='tempest-VolumesActionsTest-642530868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:05:07Z,user_data=None,user_id='32813f7d98cd485d9b69a8ca4c7a1f7a',uuid=6be14a61-4040-441b-ad4c-7ec97285c610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Converting VIF {"id": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "address": "fa:16:3e:b0:ff:4c", "network": {"id": "0cd929ee-cddb-45d6-b754-96a9834b2c1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1973200207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "283afd57674e453b8a19d978ada8790a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb18d6d-3e", "ovs_interfaceid": "6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG os_vif [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fb18d6d-3e, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:07:05 user nova-compute[70594]: INFO os_vif [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ff:4c,bridge_name='br-int',has_traffic_filtering=True,id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5,network=Network(0cd929ee-cddb-45d6-b754-96a9834b2c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb18d6d-3e')
Jul 26 17:07:05 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Deleting instance files /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610_del
Jul 26 17:07:05 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Deletion of /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610_del complete
Jul 26 17:07:06 user nova-compute[70594]: INFO nova.compute.manager [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json" returned: 1 in 0.187s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk --force-share --output=json' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:07:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000017, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/6be14a61-4040-441b-ad4c-7ec97285c610/disk
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391211.0001361, fc2f6a06-3514-44fb-9391-fce3c1182e27 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:06 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] VM Stopped (Lifecycle Event)
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4748ebb8-9a13-4659-8fe3-76ed64c206ec None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-6fc033b6-a703-4928-a059-7a262f1be380 req-1465af52-006c-4df4-8775-c975b4c9bced service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-vif-deleted-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:06 user nova-compute[70594]: INFO nova.compute.manager [req-6fc033b6-a703-4928-a059-7a262f1be380 req-1465af52-006c-4df4-8775-c975b4c9bced service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Neutron deleted interface 6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5; detaching it from the instance and deleting it from the info cache
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.network.neutron [req-6fc033b6-a703-4928-a059-7a262f1be380 req-1465af52-006c-4df4-8775-c975b4c9bced service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:06 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Took 0.65 seconds to deallocate network for instance.
Jul 26 17:07:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-6fc033b6-a703-4928-a059-7a262f1be380 req-1465af52-006c-4df4-8775-c975b4c9bced service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Detach interface failed, port_id=6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5, reason: Instance 6be14a61-4040-441b-ad4c-7ec97285c610 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-120260f2-dee3-44a5-b954-6dbdc55e49f9 req-fb93f2ce-bea6-494e-aaef-30f7e82f2d95 service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received event network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-120260f2-dee3-44a5-b954-6dbdc55e49f9 req-fb93f2ce-bea6-494e-aaef-30f7e82f2d95 service nova] Acquiring lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-120260f2-dee3-44a5-b954-6dbdc55e49f9 req-fb93f2ce-bea6-494e-aaef-30f7e82f2d95 service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-120260f2-dee3-44a5-b954-6dbdc55e49f9 req-fb93f2ce-bea6-494e-aaef-30f7e82f2d95 service nova] Lock "6be14a61-4040-441b-ad4c-7ec97285c610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-120260f2-dee3-44a5-b954-6dbdc55e49f9 req-fb93f2ce-bea6-494e-aaef-30f7e82f2d95 service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] No waiting events found dispatching network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:07 user nova-compute[70594]: WARNING nova.compute.manager [req-120260f2-dee3-44a5-b954-6dbdc55e49f9 req-fb93f2ce-bea6-494e-aaef-30f7e82f2d95 service nova] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Received unexpected event network-vif-plugged-6fb18d6d-3e5d-47b7-8e73-7a12ec7bb3a5 for instance with vm_state deleted and task_state None.
Jul 26 17:07:07 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.943s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:07 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Deleted allocations for instance 6be14a61-4040-441b-ad4c-7ec97285c610
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9d548aa9-c85c-4c20-bb46-d4edf1581a41 tempest-VolumesActionsTest-642530868 tempest-VolumesActionsTest-642530868-project-member] Lock "6be14a61-4040-441b-ad4c-7ec97285c610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.091s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:08 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:07:08 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=6968MB free_disk=25.32323455810547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 76a02a97-4400-44d2-8655-89fc12f69682 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance fc2f6a06-3514-44fb-9391-fce3c1182e27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 572dfc14-2bf8-4947-9396-63cd364ccf39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:07:08 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:07:09 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:07:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:10 user nova-compute[70594]: INFO nova.compute.manager [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Terminating instance
Jul 26 17:07:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-4666b9ef-2521-450e-b45e-f7dc059e08be req-10ce2c89-dc6b-447f-9474-8975cc078855 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-vif-unplugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4666b9ef-2521-450e-b45e-f7dc059e08be req-10ce2c89-dc6b-447f-9474-8975cc078855 service nova] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4666b9ef-2521-450e-b45e-f7dc059e08be req-10ce2c89-dc6b-447f-9474-8975cc078855 service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4666b9ef-2521-450e-b45e-f7dc059e08be req-10ce2c89-dc6b-447f-9474-8975cc078855 service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-4666b9ef-2521-450e-b45e-f7dc059e08be req-10ce2c89-dc6b-447f-9474-8975cc078855 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] No waiting events found dispatching network-vif-unplugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-4666b9ef-2521-450e-b45e-f7dc059e08be req-10ce2c89-dc6b-447f-9474-8975cc078855 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-vif-unplugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:07:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Instance destroyed successfully.
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lazy-loading 'resources' on Instance uuid d51f1e40-acab-40c5-814d-ca5022cf04c7 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-379501789',display_name='tempest-ServersNegativeTestJSON-server-379501789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-379501789',id=2,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T16:58:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e6ae07082de4f438c3cd0e80c27e39b',ramdisk_id='',reservation_id='r-7375cjiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1210249454',owner_user_name='tempest-ServersNegativeTestJSON-1210249454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T16:58:22Z,user_data=None,user_id='0475b99e94644a248b5a8b934b881c96',uuid=d51f1e40-acab-40c5-814d-ca5022cf04c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converting VIF {"id": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "address": "fa:16:3e:5c:2d:b5", "network": {"id": "f0ee2229-5a57-45ad-af4e-3fe1433bd964", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-804608425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6ae07082de4f438c3cd0e80c27e39b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bcaabb-86", "ovs_interfaceid": "19bcaabb-8678-4d58-88ce-5f087b2f0da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG os_vif [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19bcaabb-86, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:07:11 user nova-compute[70594]: INFO os_vif [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=19bcaabb-8678-4d58-88ce-5f087b2f0da3,network=Network(f0ee2229-5a57-45ad-af4e-3fe1433bd964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bcaabb-86')
Jul 26 17:07:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Deleting instance files /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7_del
Jul 26 17:07:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Deletion of /opt/stack/data/nova/instances/d51f1e40-acab-40c5-814d-ca5022cf04c7_del complete
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:07:11 user nova-compute[70594]: INFO nova.compute.manager [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-51443fea-423a-428e-a965-2388429da28d req-6bc443ac-db8a-4d83-a18f-a5a35a9cde21 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-vif-deleted-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:11 user nova-compute[70594]: INFO nova.compute.manager [req-51443fea-423a-428e-a965-2388429da28d req-6bc443ac-db8a-4d83-a18f-a5a35a9cde21 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Neutron deleted interface 19bcaabb-8678-4d58-88ce-5f087b2f0da3; detaching it from the instance and deleting it from the info cache
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.network.neutron [req-51443fea-423a-428e-a965-2388429da28d req-6bc443ac-db8a-4d83-a18f-a5a35a9cde21 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:11 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Took 0.48 seconds to deallocate network for instance.
Jul 26 17:07:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-51443fea-423a-428e-a965-2388429da28d req-6bc443ac-db8a-4d83-a18f-a5a35a9cde21 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Detach interface failed, port_id=19bcaabb-8678-4d58-88ce-5f087b2f0da3, reason: Instance d51f1e40-acab-40c5-814d-ca5022cf04c7 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391217.4811482, a624beaa-5c38-4aee-9c04-4e888e85f0f9 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:12 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] VM Stopped (Lifecycle Event)
Jul 26 17:07:12 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Deleted allocations for instance d51f1e40-acab-40c5-814d-ca5022cf04c7
Jul 26 17:07:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a806301f-f728-41af-8246-e34279dbfac7 None None] [instance: a624beaa-5c38-4aee-9c04-4e888e85f0f9] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1cb84c6f-656c-4ac8-bfcc-9e394b1f782f tempest-ServersNegativeTestJSON-1210249454 tempest-ServersNegativeTestJSON-1210249454-project-member] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-574db852-b126-4c2e-b423-8eab6ad32699 req-5c2cae80-bbe8-44ea-a7d0-21e69e0396e8 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received event network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-574db852-b126-4c2e-b423-8eab6ad32699 req-5c2cae80-bbe8-44ea-a7d0-21e69e0396e8 service nova] Acquiring lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-574db852-b126-4c2e-b423-8eab6ad32699 req-5c2cae80-bbe8-44ea-a7d0-21e69e0396e8 service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-574db852-b126-4c2e-b423-8eab6ad32699 req-5c2cae80-bbe8-44ea-a7d0-21e69e0396e8 service nova] Lock "d51f1e40-acab-40c5-814d-ca5022cf04c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-574db852-b126-4c2e-b423-8eab6ad32699 req-5c2cae80-bbe8-44ea-a7d0-21e69e0396e8 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] No waiting events found dispatching network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:13 user nova-compute[70594]: WARNING nova.compute.manager [req-574db852-b126-4c2e-b423-8eab6ad32699 req-5c2cae80-bbe8-44ea-a7d0-21e69e0396e8 service nova] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Received unexpected event network-vif-plugged-19bcaabb-8678-4d58-88ce-5f087b2f0da3 for instance with vm_state deleted and task_state None.
Jul 26 17:07:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c81829d-1694-4750-9713-6506743a5499 req-dd042e4e-31d4-4862-8f30-ae3ba5e8b0e0 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event volume-reimaged-97b1271d-393d-49d8-9a17-cb7018f78fa5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c81829d-1694-4750-9713-6506743a5499 req-dd042e4e-31d4-4862-8f30-ae3ba5e8b0e0 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c81829d-1694-4750-9713-6506743a5499 req-dd042e4e-31d4-4862-8f30-ae3ba5e8b0e0 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c81829d-1694-4750-9713-6506743a5499 req-dd042e4e-31d4-4862-8f30-ae3ba5e8b0e0 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c81829d-1694-4750-9713-6506743a5499 req-dd042e4e-31d4-4862-8f30-ae3ba5e8b0e0 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Processing event volume-reimaged-97b1271d-393d-49d8-9a17-cb7018f78fa5 {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 26 17:07:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:07:17 user nova-compute[70594]: INFO nova.virt.block_device [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Booting with volume 97b1271d-393d-49d8-9a17-cb7018f78fa5 at /dev/vda
Jul 26 17:07:18 user nova-compute[70594]: DEBUG os_brick.utils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c18fa-45e1-4f6a-90e6-90304052e7cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0222c920-557d-44fb-a261-92b37281ed1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da0aa09-17e7-4b94-900c-0630568f83c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8ea828-a70b-4d5a-ac5d-55edc72db6ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:07:18 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:07:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c67c5f-2d08-4f2a-84ca-91f67b7f896c]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG os_brick.utils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:07:18 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updating existing volume attachment record: 220a3828-2987-4563-8bf4-657721c45fd9 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:07:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:20 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391225.8302703, 6be14a61-4040-441b-ad4c-7ec97285c610 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:20 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] VM Stopped (Lifecycle Event)
Jul 26 17:07:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c331917-ab62-4523-b663-a092105bc177 None None] [instance: 6be14a61-4040-441b-ad4c-7ec97285c610] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:22 user nova-compute[70594]: INFO nova.compute.manager [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Terminating instance
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-e2612cf6-1c77-420d-9199-75f6c5181912 req-5711988e-62c4-4a1d-b787-860ea16b7809 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-vif-unplugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e2612cf6-1c77-420d-9199-75f6c5181912 req-5711988e-62c4-4a1d-b787-860ea16b7809 service nova] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e2612cf6-1c77-420d-9199-75f6c5181912 req-5711988e-62c4-4a1d-b787-860ea16b7809 service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e2612cf6-1c77-420d-9199-75f6c5181912 req-5711988e-62c4-4a1d-b787-860ea16b7809 service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-e2612cf6-1c77-420d-9199-75f6c5181912 req-5711988e-62c4-4a1d-b787-860ea16b7809 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] No waiting events found dispatching network-vif-unplugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-e2612cf6-1c77-420d-9199-75f6c5181912 req-5711988e-62c4-4a1d-b787-860ea16b7809 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-vif-unplugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:07:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Instance destroyed successfully.
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lazy-loading 'resources' on Instance uuid 6ac8029d-1df8-4648-979f-8f4fee7fdab4 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962657616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1962657',id=20,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD53vywkb9HORaVEZ5ZG7wVESHl3DqHyOC45QWCtPjl385LJWQj1Y0W2Ax+fBuRBQa36OBQ3htrmxU0R708SLT1YCgBRt1XtWUgtgTqcwtmO+B7PzOaxMWyE7LXPhJvhg==',key_name='tempest-keypair-1164210553',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:04:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0a605e82d564b7db062971ba2762482',ramdisk_id='',reservation_id='r-c42pn88m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1248746572',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19534391163c45e0ad05fda800596c89',uuid=6ac8029d-1df8-4648-979f-8f4fee7fdab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Converting VIF {"id": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "address": "fa:16:3e:5a:d0:9e", "network": {"id": "bb80e10c-2484-44c4-b890-0cc8e7969eca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1021340209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0a605e82d564b7db062971ba2762482", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e748cd0-1b", "ovs_interfaceid": "8e748cd0-1b6b-4407-835c-2f923babe6a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG os_vif [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e748cd0-1b, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:22 user nova-compute[70594]: INFO os_vif [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d0:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e748cd0-1b6b-4407-835c-2f923babe6a5,network=Network(bb80e10c-2484-44c4-b890-0cc8e7969eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e748cd0-1b')
Jul 26 17:07:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Deleting instance files /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4_del
Jul 26 17:07:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Deletion of /opt/stack/data/nova/instances/6ac8029d-1df8-4648-979f-8f4fee7fdab4_del complete
Jul 26 17:07:23 user nova-compute[70594]: INFO nova.compute.manager [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 26 17:07:23 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:07:23 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:07:23 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:07:23 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:23 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Took 0.88 seconds to deallocate network for instance.
Jul 26 17:07:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-6b53c7f5-7e58-4c8f-b5da-4b579a633bcb req-7bbf4b76-f10c-4ba9-a0a7-de2adecc26a9 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-vif-deleted-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:24 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Deleted allocations for instance 6ac8029d-1df8-4648-979f-8f4fee7fdab4
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f63510da-9b0f-4b72-a9da-75f61419b7a7 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572 tempest-TestServerVolumeAttachScenarioOldVersion-1248746572-project-member] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.488s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9fef60d-c566-4f9a-9bce-29309fa4b1d8 req-88af1d4b-b6f2-410e-bed6-25524839ec76 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received event network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9fef60d-c566-4f9a-9bce-29309fa4b1d8 req-88af1d4b-b6f2-410e-bed6-25524839ec76 service nova] Acquiring lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9fef60d-c566-4f9a-9bce-29309fa4b1d8 req-88af1d4b-b6f2-410e-bed6-25524839ec76 service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e9fef60d-c566-4f9a-9bce-29309fa4b1d8 req-88af1d4b-b6f2-410e-bed6-25524839ec76 service nova] Lock "6ac8029d-1df8-4648-979f-8f4fee7fdab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-e9fef60d-c566-4f9a-9bce-29309fa4b1d8 req-88af1d4b-b6f2-410e-bed6-25524839ec76 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] No waiting events found dispatching network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:24 user nova-compute[70594]: WARNING nova.compute.manager [req-e9fef60d-c566-4f9a-9bce-29309fa4b1d8 req-88af1d4b-b6f2-410e-bed6-25524839ec76 service nova] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Received unexpected event network-vif-plugged-8e748cd0-1b6b-4407-835c-2f923babe6a5 for instance with vm_state deleted and task_state None.
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:24 user nova-compute[70594]: INFO nova.compute.manager [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Terminating instance
Jul 26 17:07:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b3d440bf-90f2-43fa-a886-3c8044a954c8 req-00d67c5e-0779-4fe9-91f1-4a08c4030c8b service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-unplugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b3d440bf-90f2-43fa-a886-3c8044a954c8 req-00d67c5e-0779-4fe9-91f1-4a08c4030c8b service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b3d440bf-90f2-43fa-a886-3c8044a954c8 req-00d67c5e-0779-4fe9-91f1-4a08c4030c8b service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b3d440bf-90f2-43fa-a886-3c8044a954c8 req-00d67c5e-0779-4fe9-91f1-4a08c4030c8b service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b3d440bf-90f2-43fa-a886-3c8044a954c8 req-00d67c5e-0779-4fe9-91f1-4a08c4030c8b service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-unplugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b3d440bf-90f2-43fa-a886-3c8044a954c8 req-00d67c5e-0779-4fe9-91f1-4a08c4030c8b service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-unplugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:07:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Instance destroyed successfully.
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.objects.instance [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'resources' on Instance uuid 76a02a97-4400-44d2-8655-89fc12f69682 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-176363728',display_name='tempest-TestMinimumBasicScenario-server-176363728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-176363728',id=17,image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGke9iGOmvPqEKSh8QBz1Y0ruHXz1mdEoX5DAbsPsnYZuvHXRd09xN4lqJBepSsaJis60tn6XsdQ5erG81wBPM++LllZP3o1etQSYkKxJFvxlgTcLjIpEDXYCKw7/29ccQ==',key_name='tempest-TestMinimumBasicScenario-1758624021',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-b7tjwa5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7dd870d3-b195-43da-a68e-0486554bcd2a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:43Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=76a02a97-4400-44d2-8655-89fc12f69682,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "address": "fa:16:3e:70:78:e9", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf40ec4be-97", "ovs_interfaceid": "f40ec4be-97e7-4bdf-a1aa-0be24286854b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG os_vif [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf40ec4be-97, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:25 user nova-compute[70594]: INFO os_vif [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:78:e9,bridge_name='br-int',has_traffic_filtering=True,id=f40ec4be-97e7-4bdf-a1aa-0be24286854b,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf40ec4be-97')
Jul 26 17:07:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Deleting instance files /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682_del
Jul 26 17:07:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Deletion of /opt/stack/data/nova/instances/76a02a97-4400-44d2-8655-89fc12f69682_del complete
Jul 26 17:07:25 user nova-compute[70594]: INFO nova.compute.manager [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 26 17:07:25 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:07:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:26 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Took 0.47 seconds to deallocate network for instance.
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c1097f6-f753-497d-ad11-bb299e7baab0 req-8a1a84d4-bf3a-42b3-910d-79d05cdfaf9e service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-deleted-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:26 user nova-compute[70594]: INFO nova.compute.manager [req-2c1097f6-f753-497d-ad11-bb299e7baab0 req-8a1a84d4-bf3a-42b3-910d-79d05cdfaf9e service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Neutron deleted interface f40ec4be-97e7-4bdf-a1aa-0be24286854b; detaching it from the instance and deleting it from the info cache
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-2c1097f6-f753-497d-ad11-bb299e7baab0 req-8a1a84d4-bf3a-42b3-910d-79d05cdfaf9e service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c1097f6-f753-497d-ad11-bb299e7baab0 req-8a1a84d4-bf3a-42b3-910d-79d05cdfaf9e service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Detach interface failed, port_id=f40ec4be-97e7-4bdf-a1aa-0be24286854b, reason: Instance 76a02a97-4400-44d2-8655-89fc12f69682 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391231.2783716, d51f1e40-acab-40c5-814d-ca5022cf04c7 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:26 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] VM Stopped (Lifecycle Event)
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a8be4ff7-e25e-441d-8f33-0e176f459fdf None None] [instance: d51f1e40-acab-40c5-814d-ca5022cf04c7] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:26 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Deleted allocations for instance 76a02a97-4400-44d2-8655-89fc12f69682
Jul 26 17:07:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-0f38a5aa-dafc-475e-8610-d981ba7c067f tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "76a02a97-4400-44d2-8655-89fc12f69682" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.884s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-de9e52b7-97b8-4961-8c17-ff2db484a8ca req-a18863dd-fbcf-452b-a1a2-ffd49c429764 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-de9e52b7-97b8-4961-8c17-ff2db484a8ca req-a18863dd-fbcf-452b-a1a2-ffd49c429764 service nova] Acquiring lock "76a02a97-4400-44d2-8655-89fc12f69682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-de9e52b7-97b8-4961-8c17-ff2db484a8ca req-a18863dd-fbcf-452b-a1a2-ffd49c429764 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-de9e52b7-97b8-4961-8c17-ff2db484a8ca req-a18863dd-fbcf-452b-a1a2-ffd49c429764 service nova] Lock "76a02a97-4400-44d2-8655-89fc12f69682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-de9e52b7-97b8-4961-8c17-ff2db484a8ca req-a18863dd-fbcf-452b-a1a2-ffd49c429764 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] No waiting events found dispatching network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:27 user nova-compute[70594]: WARNING nova.compute.manager [req-de9e52b7-97b8-4961-8c17-ff2db484a8ca req-a18863dd-fbcf-452b-a1a2-ffd49c429764 service nova] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Received unexpected event network-vif-plugged-f40ec4be-97e7-4bdf-a1aa-0be24286854b for instance with vm_state deleted and task_state None.
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:07:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Creating image(s)
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Start _get_guest_xml network_info=[{"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc2f6a06-3514-44fb-9391-fce3c1182e27', 'attached_at': '', 'detached_at': '', 'volume_id': '97b1271d-393d-49d8-9a17-cb7018f78fa5', 'serial': '97b1271d-393d-49d8-9a17-cb7018f78fa5'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '220a3828-2987-4563-8bf4-657721c45fd9', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:07:28 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 26 17:07:28 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:07:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:07:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:07:28 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0029c52-74c2-4e5f-8238-d2afcf137bc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:07:28 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ecfaa9-727e-4dc1-9358-a220457dc687]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5] added
Jul 26 17:07:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d075e32-05da-4b10-a8d0-13d7e99d634b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb53376-410d-4ce1-a3ea-a0cfecf29682]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdzcYGMI {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdzcYGMI" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae030d98-9f1b-4f42-a88f-d92d3f7fab77]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdzcYGMI'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[17180d28-9b4b-402a-8c01-1831c475dd22]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9cc042-1f2d-418f-be19-1261b4ab209c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:07:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:07:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[147fdc1e-e11c-4699-97f3-778f1cda0994]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]
Jul 26 17:07:28 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.
Jul 26 17:07:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[080610a2-e323-4f1a-b137-5d112014edd8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b80f41-8554-48ea-a187-8c62c2229b55]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:07:28 user nova-compute[70594]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:07:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:07:28 user nova-compute[70594]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:07:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7397419-1d50-4ccd-b178-b97dd30156ba]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:07:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23164313261313634', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164313261313634', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88264397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-180134213',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEcRpCH5inq5cCtNWGZ0sP8y/LsMiqplLE8iHhed0eAKEyo6FWVuTdfDcFiP4qVJUCdHqt6pEGOStBDb13bq3q9WqN+RbObuu/4z6fq21wNlTLOSGkHBxLbST6DOWgonQ==',key_name='tempest-keypair-1106897005',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-hq0pmkvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=fc2f6a06-3514-44fb-9391-fce3c1182e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:07:29 user nova-compute[70594]:   <uuid>fc2f6a06-3514-44fb-9391-fce3c1182e27</uuid>
Jul 26 17:07:29 user nova-compute[70594]:   <name>instance-00000016</name>
Jul 26 17:07:29 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:07:29 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:07:29 user nova-compute[70594]:   <metadata>
Jul 26 17:07:29 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:07:29 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:07:29 user nova-compute[70594]:       <nova:name>tempest-ServerActionsV293TestJSON-server-88264397</nova:name>
Jul 26 17:07:29 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:07:28</nova:creationTime>
Jul 26 17:07:29 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:07:29 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:07:29 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:07:29 user nova-compute[70594]:       <nova:owner>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:user uuid="f042f51e92ac400ea26bce166a410123">tempest-ServerActionsV293TestJSON-607585814-project-member</nova:user>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:project uuid="c75af562500b4c6a8586de2079994e90">tempest-ServerActionsV293TestJSON-607585814</nova:project>
Jul 26 17:07:29 user nova-compute[70594]:       </nova:owner>
Jul 26 17:07:29 user nova-compute[70594]:       <nova:ports>
Jul 26 17:07:29 user nova-compute[70594]:         <nova:port uuid="f21510ad-d95a-446c-af00-d2ec1a59754e">
Jul 26 17:07:29 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 26 17:07:29 user nova-compute[70594]:         </nova:port>
Jul 26 17:07:29 user nova-compute[70594]:       </nova:ports>
Jul 26 17:07:29 user nova-compute[70594]:     </nova:instance>
Jul 26 17:07:29 user nova-compute[70594]:   </metadata>
Jul 26 17:07:29 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:07:29 user nova-compute[70594]:     <system>
Jul 26 17:07:29 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:07:29 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:07:29 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:07:29 user nova-compute[70594]:       <entry name="serial">fc2f6a06-3514-44fb-9391-fce3c1182e27</entry>
Jul 26 17:07:29 user nova-compute[70594]:       <entry name="uuid">fc2f6a06-3514-44fb-9391-fce3c1182e27</entry>
Jul 26 17:07:29 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:07:29 user nova-compute[70594]:     </system>
Jul 26 17:07:29 user nova-compute[70594]:   </sysinfo>
Jul 26 17:07:29 user nova-compute[70594]:   <os>
Jul 26 17:07:29 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:07:29 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:07:29 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:07:29 user nova-compute[70594]:   </os>
Jul 26 17:07:29 user nova-compute[70594]:   <features>
Jul 26 17:07:29 user nova-compute[70594]:     <acpi/>
Jul 26 17:07:29 user nova-compute[70594]:     <apic/>
Jul 26 17:07:29 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:07:29 user nova-compute[70594]:   </features>
Jul 26 17:07:29 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:07:29 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:07:29 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:07:29 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:07:29 user nova-compute[70594]:   </clock>
Jul 26 17:07:29 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:07:29 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:07:29 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:07:29 user nova-compute[70594]:   </cpu>
Jul 26 17:07:29 user nova-compute[70594]:   <devices>
Jul 26 17:07:29 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:07:29 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:07:29 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 17:07:29 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:07:29 user nova-compute[70594]:       <serial>97b1271d-393d-49d8-9a17-cb7018f78fa5</serial>
Jul 26 17:07:29 user nova-compute[70594]:     </disk>
Jul 26 17:07:29 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:07:29 user nova-compute[70594]:       <mac address="fa:16:3e:69:ab:5e"/>
Jul 26 17:07:29 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:07:29 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:07:29 user nova-compute[70594]:       <target dev="tapf21510ad-d9"/>
Jul 26 17:07:29 user nova-compute[70594]:     </interface>
Jul 26 17:07:29 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:07:29 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27/console.log" append="off"/>
Jul 26 17:07:29 user nova-compute[70594]:     </serial>
Jul 26 17:07:29 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:07:29 user nova-compute[70594]:     <video>
Jul 26 17:07:29 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:07:29 user nova-compute[70594]:     </video>
Jul 26 17:07:29 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:07:29 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:07:29 user nova-compute[70594]:     </rng>
Jul 26 17:07:29 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:07:29 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:07:29 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:07:29 user nova-compute[70594]:     </memballoon>
Jul 26 17:07:29 user nova-compute[70594]:   </devices>
Jul 26 17:07:29 user nova-compute[70594]: </domain>
Jul 26 17:07:29 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88264397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-180134213',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEcRpCH5inq5cCtNWGZ0sP8y/LsMiqplLE8iHhed0eAKEyo6FWVuTdfDcFiP4qVJUCdHqt6pEGOStBDb13bq3q9WqN+RbObuu/4z6fq21wNlTLOSGkHBxLbST6DOWgonQ==',key_name='tempest-keypair-1106897005',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-hq0pmkvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=fc2f6a06-3514-44fb-9391-fce3c1182e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG os_vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf21510ad-d9, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf21510ad-d9, col_values=(('external_ids', {'iface-id': 'f21510ad-d95a-446c-af00-d2ec1a59754e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:ab:5e', 'vm-uuid': 'fc2f6a06-3514-44fb-9391-fce3c1182e27'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:29 user nova-compute[70594]: INFO os_vif [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9')
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:07:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] No VIF found with MAC fa:16:3e:69:ab:5e, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:07:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-208a04f2-340b-41e3-a22d-3ee271ad83c7 req-ce223ea7-937b-4bab-b546-dcfa184d7b06 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-208a04f2-340b-41e3-a22d-3ee271ad83c7 req-ce223ea7-937b-4bab-b546-dcfa184d7b06 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-208a04f2-340b-41e3-a22d-3ee271ad83c7 req-ce223ea7-937b-4bab-b546-dcfa184d7b06 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-208a04f2-340b-41e3-a22d-3ee271ad83c7 req-ce223ea7-937b-4bab-b546-dcfa184d7b06 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-208a04f2-340b-41e3-a22d-3ee271ad83c7 req-ce223ea7-937b-4bab-b546-dcfa184d7b06 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:31 user nova-compute[70594]: WARNING nova.compute.manager [req-208a04f2-340b-41e3-a22d-3ee271ad83c7 req-ce223ea7-937b-4bab-b546-dcfa184d7b06 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state active and task_state rebuild_spawning.
Jul 26 17:07:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391253.1221936, fc2f6a06-3514-44fb-9391-fce3c1182e27 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:33 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] VM Resumed (Lifecycle Event)
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:07:33 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance spawned successfully.
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-ed987be3-1cd6-43ab-a97e-1f0274aea64d req-6f562c29-1d3f-41c1-9da8-33e1e41a0a6b service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed987be3-1cd6-43ab-a97e-1f0274aea64d req-6f562c29-1d3f-41c1-9da8-33e1e41a0a6b service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed987be3-1cd6-43ab-a97e-1f0274aea64d req-6f562c29-1d3f-41c1-9da8-33e1e41a0a6b service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed987be3-1cd6-43ab-a97e-1f0274aea64d req-6f562c29-1d3f-41c1-9da8-33e1e41a0a6b service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-ed987be3-1cd6-43ab-a97e-1f0274aea64d req-6f562c29-1d3f-41c1-9da8-33e1e41a0a6b service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:33 user nova-compute[70594]: WARNING nova.compute.manager [req-ed987be3-1cd6-43ab-a97e-1f0274aea64d req-6f562c29-1d3f-41c1-9da8-33e1e41a0a6b service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state active and task_state rebuild_spawning.
Jul 26 17:07:33 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391253.1239164, fc2f6a06-3514-44fb-9391-fce3c1182e27 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:33 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] VM Started (Lifecycle Event)
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:07:33 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70594) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 26 17:07:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c81829d-1694-4750-9713-6506743a5499 tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.104s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing instance network info cache due to event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updated VIF entry in instance network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c1bfda1f-01ed-415b-aac5-596daf61fce2 req-86e09e91-4730-4d76-b30c-2ce7ba6fbdb1 service nova] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:07:37 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391242.9299433, 6ac8029d-1df8-4648-979f-8f4fee7fdab4 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:37 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] VM Stopped (Lifecycle Event)
Jul 26 17:07:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8ee6d60e-aec5-419c-bf2b-e9a641c86a7e None None] [instance: 6ac8029d-1df8-4648-979f-8f4fee7fdab4] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:40 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391245.550897, 76a02a97-4400-44d2-8655-89fc12f69682 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:40 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] VM Stopped (Lifecycle Event)
Jul 26 17:07:40 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3064f612-4f8f-4f6c-b8be-e62d9a03204d None None] [instance: 76a02a97-4400-44d2-8655-89fc12f69682] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:41 user nova-compute[70594]: INFO nova.compute.manager [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Shelving
Jul 26 17:07:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-e39a18ad-21e3-473c-a759-d2c4ccab86d6 req-16e1543f-e15b-4ef3-9f66-d31255176121 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-unplugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e39a18ad-21e3-473c-a759-d2c4ccab86d6 req-16e1543f-e15b-4ef3-9f66-d31255176121 service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e39a18ad-21e3-473c-a759-d2c4ccab86d6 req-16e1543f-e15b-4ef3-9f66-d31255176121 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e39a18ad-21e3-473c-a759-d2c4ccab86d6 req-16e1543f-e15b-4ef3-9f66-d31255176121 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-e39a18ad-21e3-473c-a759-d2c4ccab86d6 req-16e1543f-e15b-4ef3-9f66-d31255176121 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-unplugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:41 user nova-compute[70594]: WARNING nova.compute.manager [req-e39a18ad-21e3-473c-a759-d2c4ccab86d6 req-16e1543f-e15b-4ef3-9f66-d31255176121 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-unplugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state active and task_state shelving.
Jul 26 17:07:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance destroyed successfully.
Jul 26 17:07:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Beginning cold snapshot process
Jul 26 17:07:42 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:07:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk /opt/stack/data/nova/instances/snapshots/tmpdsyz5jbl/600d5ee6843f4021b454dfaed8b8b8f7 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:07:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk /opt/stack/data/nova/instances/snapshots/tmpdsyz5jbl/600d5ee6843f4021b454dfaed8b8b8f7" returned: 0 in 0.908s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:07:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Snapshot extracted, beginning image upload
Jul 26 17:07:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-74096c59-141e-4e21-bae5-472d5c6e7910 req-bce9dc66-1b3d-45ba-a5bd-1f2bf29f08b5 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-74096c59-141e-4e21-bae5-472d5c6e7910 req-bce9dc66-1b3d-45ba-a5bd-1f2bf29f08b5 service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-74096c59-141e-4e21-bae5-472d5c6e7910 req-bce9dc66-1b3d-45ba-a5bd-1f2bf29f08b5 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-74096c59-141e-4e21-bae5-472d5c6e7910 req-bce9dc66-1b3d-45ba-a5bd-1f2bf29f08b5 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-74096c59-141e-4e21-bae5-472d5c6e7910 req-bce9dc66-1b3d-45ba-a5bd-1f2bf29f08b5 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:07:43 user nova-compute[70594]: WARNING nova.compute.manager [req-74096c59-141e-4e21-bae5-472d5c6e7910 req-bce9dc66-1b3d-45ba-a5bd-1f2bf29f08b5 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state active and task_state shelving_image_uploading.
Jul 26 17:07:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Snapshot image upload complete
Jul 26 17:07:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:45 user nova-compute[70594]: INFO nova.compute.manager [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Shelve offloading
Jul 26 17:07:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance destroyed successfully.
Jul 26 17:07:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:07:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:07:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:07:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:07:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance destroyed successfully.
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'resources' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-971400957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-971400957',id=24,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAf5rqS8Wqw9PQMSjYkvvxQN63l0mAm/rtFRp46spruamljCb7ZCObtt5TmiXb4sh0Ng2eA9FbtdAaJFc3QYZXih6J5yWU3QqpVH1hVnKPRO2LUdsEm4kCpz/MZ474Iwg==',key_name='tempest-keypair-1944995380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-1rhi3h8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member',shelved_at='2023-07-26T17:07:45.419604',shelved_host='user',shelved_image_id='3ba5d89a-2b38-4460-9936-80f7c426522b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=572dfc14-2bf8-4947-9396-63cd364ccf39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG os_vif [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa89a2f0d-bf, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing instance network info cache due to event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:07:47 user nova-compute[70594]: INFO os_vif [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf')
Jul 26 17:07:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Deleting instance files /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39_del
Jul 26 17:07:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Deletion of /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39_del complete
Jul 26 17:07:47 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Deleted allocations for instance 572dfc14-2bf8-4947-9396-63cd364ccf39
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'numa_topology' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updated VIF entry in instance network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b8bbd7d0-a190-4c7a-a44b-44e51911d840 req-4823c911-cc77-47dd-97b3-f42fb6b48bc8 service nova] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:07:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2d69e0b6-3902-4963-bc1e-1bbb43f1dbb3 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.462s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:07:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:56 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391261.9328127, 572dfc14-2bf8-4947-9396-63cd364ccf39 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:07:56 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] VM Stopped (Lifecycle Event)
Jul 26 17:07:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-affc5afa-1500-41e9-b738-488b3962d590 None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:07:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:07:59 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:03 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:08:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:08:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:07 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:07 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7212MB free_disk=25.3172607421875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance fc2f6a06-3514-44fb-9391-fce3c1182e27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:08:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:08:08 user nova-compute[70594]: INFO nova.compute.claims [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Claim successful on node user
Jul 26 17:08:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:08:09 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.policy [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7389a1c933cc4c24b20281842b82e83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b689bf7a7c5049dbac0edae98843930c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:08:09 user nova-compute[70594]: INFO nova.compute.manager [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Unrescuing
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.network.neutron [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:08:09 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Creating image(s)
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk 1073741824" returned: 0 in 0.064s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:08:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'flavor' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Cannot resize image /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'migration_context' on Instance uuid f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Ensure instance console log exists: /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-055d21e8-f6d5-4d80-9494-96128e599e05 req-7856a0dc-a455-4924-a0cd-e77859ff8b64 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-055d21e8-f6d5-4d80-9494-96128e599e05 req-7856a0dc-a455-4924-a0cd-e77859ff8b64 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-055d21e8-f6d5-4d80-9494-96128e599e05 req-7856a0dc-a455-4924-a0cd-e77859ff8b64 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-055d21e8-f6d5-4d80-9494-96128e599e05 req-7856a0dc-a455-4924-a0cd-e77859ff8b64 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-055d21e8-f6d5-4d80-9494-96128e599e05 req-7856a0dc-a455-4924-a0cd-e77859ff8b64 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:10 user nova-compute[70594]: WARNING nova.compute.manager [req-055d21e8-f6d5-4d80-9494-96128e599e05 req-7856a0dc-a455-4924-a0cd-e77859ff8b64 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:08:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Successfully created port: 2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:08:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:10 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance destroyed successfully.
Jul 26 17:08:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Successfully updated port: 2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquired lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-changed-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Refreshing instance network info cache due to event network-changed-2af76f49-4e55-49ae-a1c4-b4d30309ff95. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] Acquiring lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:08:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updating instance_info_cache with network_info: [{"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Releasing lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Instance network_info: |[{"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] Acquired lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Refreshing network info cache for port 2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Start _get_guest_xml network_info=[{"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:08:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-464258922',display_name='tempest-AttachVolumeNegativeTest-server-464258922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-464258922',id=28,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ98/MMSWgjqKXeSi9j/Fai7pXUadQ2/mOTYijeirFittceow8Ed6ajJx5HyetHhTnyugsxEQlXaV+pnRLJonybV3hxTyXCzcMJb+sRdheCyBn0BwrGHf8kxTujBmgXjrw==',key_name='tempest-keypair-813831144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-d4gk06vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=f6206aea-d091-4f94-97cc-bb940e53a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.objects.instance [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'pci_devices' on Instance uuid f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:08:12 user nova-compute[70594]:   <uuid>f6206aea-d091-4f94-97cc-bb940e53a699</uuid>
Jul 26 17:08:12 user nova-compute[70594]:   <name>instance-0000001c</name>
Jul 26 17:08:12 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:08:12 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:08:12 user nova-compute[70594]:   <metadata>
Jul 26 17:08:12 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:08:12 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:08:12 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeNegativeTest-server-464258922</nova:name>
Jul 26 17:08:12 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:08:12</nova:creationTime>
Jul 26 17:08:12 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:08:12 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:08:12 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:08:12 user nova-compute[70594]:       <nova:owner>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:user uuid="7389a1c933cc4c24b20281842b82e83b">tempest-AttachVolumeNegativeTest-1151062115-project-member</nova:user>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:project uuid="b689bf7a7c5049dbac0edae98843930c">tempest-AttachVolumeNegativeTest-1151062115</nova:project>
Jul 26 17:08:12 user nova-compute[70594]:       </nova:owner>
Jul 26 17:08:12 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:08:12 user nova-compute[70594]:       <nova:ports>
Jul 26 17:08:12 user nova-compute[70594]:         <nova:port uuid="2af76f49-4e55-49ae-a1c4-b4d30309ff95">
Jul 26 17:08:12 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 26 17:08:12 user nova-compute[70594]:         </nova:port>
Jul 26 17:08:12 user nova-compute[70594]:       </nova:ports>
Jul 26 17:08:12 user nova-compute[70594]:     </nova:instance>
Jul 26 17:08:12 user nova-compute[70594]:   </metadata>
Jul 26 17:08:12 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:08:12 user nova-compute[70594]:     <system>
Jul 26 17:08:12 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:08:12 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:08:12 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:08:12 user nova-compute[70594]:       <entry name="serial">f6206aea-d091-4f94-97cc-bb940e53a699</entry>
Jul 26 17:08:12 user nova-compute[70594]:       <entry name="uuid">f6206aea-d091-4f94-97cc-bb940e53a699</entry>
Jul 26 17:08:12 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:08:12 user nova-compute[70594]:     </system>
Jul 26 17:08:12 user nova-compute[70594]:   </sysinfo>
Jul 26 17:08:12 user nova-compute[70594]:   <os>
Jul 26 17:08:12 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:08:12 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:08:12 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:08:12 user nova-compute[70594]:   </os>
Jul 26 17:08:12 user nova-compute[70594]:   <features>
Jul 26 17:08:12 user nova-compute[70594]:     <acpi/>
Jul 26 17:08:12 user nova-compute[70594]:     <apic/>
Jul 26 17:08:12 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:08:12 user nova-compute[70594]:   </features>
Jul 26 17:08:12 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:08:12 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:08:12 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:08:12 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:08:12 user nova-compute[70594]:   </clock>
Jul 26 17:08:12 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:08:12 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:08:12 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:08:12 user nova-compute[70594]:   </cpu>
Jul 26 17:08:12 user nova-compute[70594]:   <devices>
Jul 26 17:08:12 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:08:12 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:08:12 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk"/>
Jul 26 17:08:12 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:08:12 user nova-compute[70594]:     </disk>
Jul 26 17:08:12 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:08:12 user nova-compute[70594]:       <mac address="fa:16:3e:a5:23:44"/>
Jul 26 17:08:12 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:12 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:08:12 user nova-compute[70594]:       <target dev="tap2af76f49-4e"/>
Jul 26 17:08:12 user nova-compute[70594]:     </interface>
Jul 26 17:08:12 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:08:12 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/console.log" append="off"/>
Jul 26 17:08:12 user nova-compute[70594]:     </serial>
Jul 26 17:08:12 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:08:12 user nova-compute[70594]:     <video>
Jul 26 17:08:12 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:12 user nova-compute[70594]:     </video>
Jul 26 17:08:12 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:08:12 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:08:12 user nova-compute[70594]:     </rng>
Jul 26 17:08:12 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:08:12 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:08:12 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:08:12 user nova-compute[70594]:     </memballoon>
Jul 26 17:08:12 user nova-compute[70594]:   </devices>
Jul 26 17:08:12 user nova-compute[70594]: </domain>
Jul 26 17:08:12 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-464258922',display_name='tempest-AttachVolumeNegativeTest-server-464258922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-464258922',id=28,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ98/MMSWgjqKXeSi9j/Fai7pXUadQ2/mOTYijeirFittceow8Ed6ajJx5HyetHhTnyugsxEQlXaV+pnRLJonybV3hxTyXCzcMJb+sRdheCyBn0BwrGHf8kxTujBmgXjrw==',key_name='tempest-keypair-813831144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-d4gk06vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=f6206aea-d091-4f94-97cc-bb940e53a699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG os_vif [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2af76f49-4e, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2af76f49-4e, col_values=(('external_ids', {'iface-id': '2af76f49-4e55-49ae-a1c4-b4d30309ff95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:23:44', 'vm-uuid': 'f6206aea-d091-4f94-97cc-bb940e53a699'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: INFO os_vif [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e')
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:a5:23:44, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-28dd5f5f-bba3-46d2-8040-955764480fb0 req-b05087bb-d86b-410e-a6c3-6ef4714ac55d service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-28dd5f5f-bba3-46d2-8040-955764480fb0 req-b05087bb-d86b-410e-a6c3-6ef4714ac55d service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-28dd5f5f-bba3-46d2-8040-955764480fb0 req-b05087bb-d86b-410e-a6c3-6ef4714ac55d service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-28dd5f5f-bba3-46d2-8040-955764480fb0 req-b05087bb-d86b-410e-a6c3-6ef4714ac55d service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-28dd5f5f-bba3-46d2-8040-955764480fb0 req-b05087bb-d86b-410e-a6c3-6ef4714ac55d service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:12 user nova-compute[70594]: WARNING nova.compute.manager [req-28dd5f5f-bba3-46d2-8040-955764480fb0 req-b05087bb-d86b-410e-a6c3-6ef4714ac55d service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updated VIF entry in instance network info cache for port 2af76f49-4e55-49ae-a1c4-b4d30309ff95. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updating instance_info_cache with network_info: [{"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-eb4b6e8c-70c7-4675-a4e3-1975a4941ff3 req-9f3ec4fd-87ca-4d7f-8f3f-6139ff9f4075 service nova] Releasing lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:14 user nova-compute[70594]: WARNING nova.compute.manager [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:08:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:14 user nova-compute[70594]: WARNING nova.compute.manager [req-1b02b544-7720-4a2e-a3d2-0a105b13f555 req-439120e8-23fa-400e-b1c0-f55d065bfd1b service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:08:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-42c17a1d-79e1-412d-af3e-6c75111f4b03 req-ca109732-0916-45d5-9959-3b7a2da290f6 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-42c17a1d-79e1-412d-af3e-6c75111f4b03 req-ca109732-0916-45d5-9959-3b7a2da290f6 service nova] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-42c17a1d-79e1-412d-af3e-6c75111f4b03 req-ca109732-0916-45d5-9959-3b7a2da290f6 service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-42c17a1d-79e1-412d-af3e-6c75111f4b03 req-ca109732-0916-45d5-9959-3b7a2da290f6 service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-42c17a1d-79e1-412d-af3e-6c75111f4b03 req-ca109732-0916-45d5-9959-3b7a2da290f6 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] No waiting events found dispatching network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:14 user nova-compute[70594]: WARNING nova.compute.manager [req-42c17a1d-79e1-412d-af3e-6c75111f4b03 req-ca109732-0916-45d5-9959-3b7a2da290f6 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received unexpected event network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 for instance with vm_state building and task_state spawning.
Jul 26 17:08:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 8ef02326-71b1-43ca-a53d-c2f73b049896 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391296.1569047, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Resumed (Lifecycle Event)
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-049c1559-7794-49c2-892b-3d58c68367a6 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391296.1630588, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Started (Lifecycle Event)
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391296.5952454, f6206aea-d091-4f94-97cc-bb940e53a699 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] VM Resumed (Lifecycle Event)
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Instance spawned successfully.
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391296.5963624, f6206aea-d091-4f94-97cc-bb940e53a699 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] VM Started (Lifecycle Event)
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-7d7fc25e-7f7f-4b02-ae6a-2b00b098807f req-ee55f619-b422-45af-ab5b-87878dd6d4ed service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7d7fc25e-7f7f-4b02-ae6a-2b00b098807f req-ee55f619-b422-45af-ab5b-87878dd6d4ed service nova] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7d7fc25e-7f7f-4b02-ae6a-2b00b098807f req-ee55f619-b422-45af-ab5b-87878dd6d4ed service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7d7fc25e-7f7f-4b02-ae6a-2b00b098807f req-ee55f619-b422-45af-ab5b-87878dd6d4ed service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-7d7fc25e-7f7f-4b02-ae6a-2b00b098807f req-ee55f619-b422-45af-ab5b-87878dd6d4ed service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] No waiting events found dispatching network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:16 user nova-compute[70594]: WARNING nova.compute.manager [req-7d7fc25e-7f7f-4b02-ae6a-2b00b098807f req-ee55f619-b422-45af-ab5b-87878dd6d4ed service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received unexpected event network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 for instance with vm_state building and task_state spawning.
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Took 7.35 seconds to spawn the instance on the hypervisor.
Jul 26 17:08:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:16 user nova-compute[70594]: INFO nova.compute.manager [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Took 8.20 seconds to build instance.
Jul 26 17:08:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-88e8410d-0d17-4925-880d-da57aa71768c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.319s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:08:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:19 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:08:19 user nova-compute[70594]: INFO nova.compute.claims [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Claim successful on node user
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:08:20 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.policy [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '522b55c463ac450ebf618c8fdc44a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549ece99958b4c54a8581fe37b3ced92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:08:20 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Creating image(s)
Jul 26 17:08:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "/opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "/opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "/opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "45108d368c6b41c7c11326f57730dab74401a175" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "45108d368c6b41c7c11326f57730dab74401a175" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.part --force-share --output=json" returned: 0 in 0.214s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG nova.virt.images [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] a4498700-d662-41ba-b1af-35bdcc3af61a was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.part /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Successfully created port: a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.part /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.converted" returned: 0 in 0.212s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "45108d368c6b41c7c11326f57730dab74401a175" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.149s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175 --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175 --force-share --output=json" returned: 0 in 0.186s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "45108d368c6b41c7c11326f57730dab74401a175" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "45108d368c6b41c7c11326f57730dab74401a175" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175 --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175 --force-share --output=json" returned: 0 in 0.188s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175,backing_fmt=raw /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175,backing_fmt=raw /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk 1073741824" returned: 0 in 0.073s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "45108d368c6b41c7c11326f57730dab74401a175" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175 --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Successfully updated port: a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45108d368c6b41c7c11326f57730dab74401a175 --force-share --output=json" returned: 0 in 0.191s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing instance network info cache due to event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Cannot resize image /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'migration_context' on Instance uuid 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Ensure instance console log exists: /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance network_info: |[{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Start _get_guest_xml network_info=[{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T17:08:16Z,direct_url=<?>,disk_format='qcow2',id=a4498700-d662-41ba-b1af-35bdcc3af61a,min_disk=0,min_ram=0,name='tempest-scenario-img--874608409',owner='549ece99958b4c54a8581fe37b3ced92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T17:08:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'a4498700-d662-41ba-b1af-35bdcc3af61a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:08:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T17:08:16Z,direct_url=<?>,disk_format='qcow2',id=a4498700-d662-41ba-b1af-35bdcc3af61a,min_disk=0,min_ram=0,name='tempest-scenario-img--874608409',owner='549ece99958b4c54a8581fe37b3ced92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T17:08:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1581202798',display_name='tempest-TestMinimumBasicScenario-server-1581202798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1581202798',id=29,image_ref='a4498700-d662-41ba-b1af-35bdcc3af61a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFFGAJAgPkWshC1RRmM6moKBbgA9DoD5tyRD7WsLZaoMa1EtmIGidJX9qYN5iLLtj8FyjJVfeBsSabHf2Q1ESUlSa6gy584jeO4jIzwNeZMTC3JZMNkr6GPN9HotBFQ+A==',key_name='tempest-TestMinimumBasicScenario-221071219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-on8dm933',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4498700-d662-41ba-b1af-35bdcc3af61a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:21Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=7198cc04-ff6c-4a24-8e4f-e5db85060811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.objects.instance [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'pci_devices' on Instance uuid 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:08:23 user nova-compute[70594]:   <uuid>7198cc04-ff6c-4a24-8e4f-e5db85060811</uuid>
Jul 26 17:08:23 user nova-compute[70594]:   <name>instance-0000001d</name>
Jul 26 17:08:23 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:08:23 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:08:23 user nova-compute[70594]:   <metadata>
Jul 26 17:08:23 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:08:23 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:08:23 user nova-compute[70594]:       <nova:name>tempest-TestMinimumBasicScenario-server-1581202798</nova:name>
Jul 26 17:08:23 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:08:23</nova:creationTime>
Jul 26 17:08:23 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:08:23 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:08:23 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:08:23 user nova-compute[70594]:       <nova:owner>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:user uuid="522b55c463ac450ebf618c8fdc44a8b5">tempest-TestMinimumBasicScenario-1770089512-project-member</nova:user>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:project uuid="549ece99958b4c54a8581fe37b3ced92">tempest-TestMinimumBasicScenario-1770089512</nova:project>
Jul 26 17:08:23 user nova-compute[70594]:       </nova:owner>
Jul 26 17:08:23 user nova-compute[70594]:       <nova:root type="image" uuid="a4498700-d662-41ba-b1af-35bdcc3af61a"/>
Jul 26 17:08:23 user nova-compute[70594]:       <nova:ports>
Jul 26 17:08:23 user nova-compute[70594]:         <nova:port uuid="a2dcd74b-a228-4a88-a0bc-ec8bab9d681e">
Jul 26 17:08:23 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 26 17:08:23 user nova-compute[70594]:         </nova:port>
Jul 26 17:08:23 user nova-compute[70594]:       </nova:ports>
Jul 26 17:08:23 user nova-compute[70594]:     </nova:instance>
Jul 26 17:08:23 user nova-compute[70594]:   </metadata>
Jul 26 17:08:23 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:08:23 user nova-compute[70594]:     <system>
Jul 26 17:08:23 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:08:23 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:08:23 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:08:23 user nova-compute[70594]:       <entry name="serial">7198cc04-ff6c-4a24-8e4f-e5db85060811</entry>
Jul 26 17:08:23 user nova-compute[70594]:       <entry name="uuid">7198cc04-ff6c-4a24-8e4f-e5db85060811</entry>
Jul 26 17:08:23 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:08:23 user nova-compute[70594]:     </system>
Jul 26 17:08:23 user nova-compute[70594]:   </sysinfo>
Jul 26 17:08:23 user nova-compute[70594]:   <os>
Jul 26 17:08:23 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:08:23 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:08:23 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:08:23 user nova-compute[70594]:   </os>
Jul 26 17:08:23 user nova-compute[70594]:   <features>
Jul 26 17:08:23 user nova-compute[70594]:     <acpi/>
Jul 26 17:08:23 user nova-compute[70594]:     <apic/>
Jul 26 17:08:23 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:08:23 user nova-compute[70594]:   </features>
Jul 26 17:08:23 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:08:23 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:08:23 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:08:23 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:08:23 user nova-compute[70594]:   </clock>
Jul 26 17:08:23 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:08:23 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:08:23 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:08:23 user nova-compute[70594]:   </cpu>
Jul 26 17:08:23 user nova-compute[70594]:   <devices>
Jul 26 17:08:23 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:08:23 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:08:23 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk"/>
Jul 26 17:08:23 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:08:23 user nova-compute[70594]:     </disk>
Jul 26 17:08:23 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:08:23 user nova-compute[70594]:       <mac address="fa:16:3e:5c:0b:4c"/>
Jul 26 17:08:23 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:23 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:08:23 user nova-compute[70594]:       <target dev="tapa2dcd74b-a2"/>
Jul 26 17:08:23 user nova-compute[70594]:     </interface>
Jul 26 17:08:23 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:08:23 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/console.log" append="off"/>
Jul 26 17:08:23 user nova-compute[70594]:     </serial>
Jul 26 17:08:23 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:08:23 user nova-compute[70594]:     <video>
Jul 26 17:08:23 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:23 user nova-compute[70594]:     </video>
Jul 26 17:08:23 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:08:23 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:08:23 user nova-compute[70594]:     </rng>
Jul 26 17:08:23 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:08:23 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:08:23 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:08:23 user nova-compute[70594]:     </memballoon>
Jul 26 17:08:23 user nova-compute[70594]:   </devices>
Jul 26 17:08:23 user nova-compute[70594]: </domain>
Jul 26 17:08:23 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1581202798',display_name='tempest-TestMinimumBasicScenario-server-1581202798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1581202798',id=29,image_ref='a4498700-d662-41ba-b1af-35bdcc3af61a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFFGAJAgPkWshC1RRmM6moKBbgA9DoD5tyRD7WsLZaoMa1EtmIGidJX9qYN5iLLtj8FyjJVfeBsSabHf2Q1ESUlSa6gy584jeO4jIzwNeZMTC3JZMNkr6GPN9HotBFQ+A==',key_name='tempest-TestMinimumBasicScenario-221071219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-on8dm933',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4498700-d662-41ba-b1af-35bdcc3af61a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:21Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=7198cc04-ff6c-4a24-8e4f-e5db85060811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG os_vif [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2dcd74b-a2, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2dcd74b-a2, col_values=(('external_ids', {'iface-id': 'a2dcd74b-a228-4a88-a0bc-ec8bab9d681e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:0b:4c', 'vm-uuid': '7198cc04-ff6c-4a24-8e4f-e5db85060811'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:23 user nova-compute[70594]: INFO os_vif [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2')
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No VIF found with MAC fa:16:3e:5c:0b:4c, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updated VIF entry in instance network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1834afb8-cafa-4659-afc1-3666fa6ec3cb req-4dbe2f1e-0d76-4c38-a7f1-44d0d6246f4f service nova] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-a048f032-f272-470b-9c75-271ce6a1eb87 req-0495e750-fd9b-4986-939e-01dc2f2d83ab service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a048f032-f272-470b-9c75-271ce6a1eb87 req-0495e750-fd9b-4986-939e-01dc2f2d83ab service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a048f032-f272-470b-9c75-271ce6a1eb87 req-0495e750-fd9b-4986-939e-01dc2f2d83ab service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a048f032-f272-470b-9c75-271ce6a1eb87 req-0495e750-fd9b-4986-939e-01dc2f2d83ab service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-a048f032-f272-470b-9c75-271ce6a1eb87 req-0495e750-fd9b-4986-939e-01dc2f2d83ab service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:25 user nova-compute[70594]: WARNING nova.compute.manager [req-a048f032-f272-470b-9c75-271ce6a1eb87 req-0495e750-fd9b-4986-939e-01dc2f2d83ab service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state building and task_state spawning.
Jul 26 17:08:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-3eba5ac6-6663-439b-8980-e28b849a7693 req-663daa2b-5a07-418f-9d30-8b00902fd93d service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3eba5ac6-6663-439b-8980-e28b849a7693 req-663daa2b-5a07-418f-9d30-8b00902fd93d service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3eba5ac6-6663-439b-8980-e28b849a7693 req-663daa2b-5a07-418f-9d30-8b00902fd93d service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3eba5ac6-6663-439b-8980-e28b849a7693 req-663daa2b-5a07-418f-9d30-8b00902fd93d service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-3eba5ac6-6663-439b-8980-e28b849a7693 req-663daa2b-5a07-418f-9d30-8b00902fd93d service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:27 user nova-compute[70594]: WARNING nova.compute.manager [req-3eba5ac6-6663-439b-8980-e28b849a7693 req-663daa2b-5a07-418f-9d30-8b00902fd93d service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state building and task_state spawning.
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391307.378175, 7198cc04-ff6c-4a24-8e4f-e5db85060811 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] VM Resumed (Lifecycle Event)
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance spawned successfully.
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391307.3851612, 7198cc04-ff6c-4a24-8e4f-e5db85060811 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] VM Started (Lifecycle Event)
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Took 6.67 seconds to spawn the instance on the hypervisor.
Jul 26 17:08:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:27 user nova-compute[70594]: INFO nova.compute.manager [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Took 7.75 seconds to build instance.
Jul 26 17:08:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-722a79f1-95e1-486b-849a-d2c7ecfe1c35 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.863s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-changed-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Refreshing instance network info cache due to event network-changed-5ef9e468-621a-440e-8561-ab66e60d5b8b. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] Acquiring lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] Acquired lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Refreshing network info cache for port 5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updated VIF entry in instance network info cache for port 5ef9e468-621a-440e-8561-ab66e60d5b8b. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-828ca251-b720-4cbe-83a3-ea4fd2faa435 req-5623af51-d501-47bc-8ae4-f7a94e4bcdb3 service nova] Releasing lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing instance network info cache due to event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'flavor' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updated VIF entry in instance network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:37 user nova-compute[70594]: INFO nova.compute.manager [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Attaching volume 14216eeb-e0b3-47c2-b5f6-10496a11d60f to /dev/vdb
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7884cd3e-b032-40c6-9826-f45472a1cff4 req-48440b58-98b3-49cc-9e99-dd4ba7e28e8c service nova] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG os_brick.utils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43235dcc-0096-4c47-9045-f1eebcfb9f82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[91315296-50a0-4320-82f9-2b4d276e0e1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[601da82f-2ae4-42a5-ba40-7763480ccbd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab4126-cd14-4be3-9c77-c9f6d8594646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:08:37 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:08:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ff6b7-4b9d-47a4-bec7-1434517261ec]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG os_brick.utils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:08:37 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating existing volume attachment record: 96590121-6e4b-4597-bc51-596b834440d4 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:38 user nova-compute[70594]: INFO nova.compute.manager [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Attaching volume b4233220-d3cd-4278-960b-5592325d5e63 to /dev/vdb
Jul 26 17:08:38 user nova-compute[70594]: DEBUG os_brick.utils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e783dcc-ddbf-4bfa-ad04-3781d4ca2fca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8149f00-1c98-4a0e-953c-7b79ccdd2495]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5681be1-dc1e-412b-9f54-22736a6e1bf8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[db042478-dafe-4c83-9016-c4d2bf796841]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:08:38 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:08:38 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b2dc3-0f0a-425f-845a-727786e83e9e]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG os_brick.utils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:08:38 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating existing volume attachment record: ce4cf7fe-7ca6-4630-86ea-0564245a202b {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:08:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:42 user nova-compute[70594]: INFO nova.compute.manager [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Terminating instance
Jul 26 17:08:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Instance destroyed successfully.
Jul 26 17:08:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'resources' on Instance uuid fc2f6a06-3514-44fb-9391-fce3c1182e27 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-88264397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-180134213',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEcRpCH5inq5cCtNWGZ0sP8y/LsMiqplLE8iHhed0eAKEyo6FWVuTdfDcFiP4qVJUCdHqt6pEGOStBDb13bq3q9WqN+RbObuu/4z6fq21wNlTLOSGkHBxLbST6DOWgonQ==',key_name='tempest-keypair-1106897005',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-hq0pmkvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=fc2f6a06-3514-44fb-9391-fce3c1182e27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "f21510ad-d95a-446c-af00-d2ec1a59754e", "address": "fa:16:3e:69:ab:5e", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21510ad-d9", "ovs_interfaceid": "f21510ad-d95a-446c-af00-d2ec1a59754e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_vif [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf21510ad-d9, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:08:43 user nova-compute[70594]: INFO os_vif [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ab:5e,bridge_name='br-int',has_traffic_filtering=True,id=f21510ad-d95a-446c-af00-d2ec1a59754e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21510ad-d9')
Jul 26 17:08:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdzcYGMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:08:43 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a4c2ea-3d1c-42df-b686-f4268dc4fd1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:08:43 user nova-compute[70594]: No targets found.
Jul 26 17:08:43 user nova-compute[70594]: iSNS:
Jul 26 17:08:43 user nova-compute[70594]: No targets found.
Jul 26 17:08:43 user nova-compute[70594]: STATIC:
Jul 26 17:08:43 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:08:43 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:08:43 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:08:43 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5
Jul 26 17:08:43 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:08:43 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:08:43 user nova-compute[70594]: FIRMWARE:
Jul 26 17:08:43 user nova-compute[70594]: No targets found.
Jul 26 17:08:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:08:43 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:08:43 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba119e8d-4c63-4bb3-ab36-11e215cc6bc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cbb468-5b65-43fb-983c-992f033bb511]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:43 user nova-compute[70594]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:08:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:43 user nova-compute[70594]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 (non-flash)
Jul 26 17:08:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5900507a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[88318643-384a-4c0c-ae3b-a05741f230b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e881581a-d043-432b-8700-d9c15ca6fdcd]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d999657-3a39-453f-a0c2-093caa07c6a2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495d0b2-16bd-4953-bb30-a8591b090ba8]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aea77f31',) {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1a6896-5578-48f2-b472-5e88e7c19037]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966a903-46cc-4d2a-b546-bfbb3a7f6fbb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e94ac-ecc9-4567-b8f9-fb199e79ba65]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260]
Jul 26 17:08:43 user nova-compute[70594]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5, portal: 172.16.0.220,3260] successful.
Jul 26 17:08:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b1271d-393d-49d8-9a17-cb7018f78fa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e94abcc-aee6-4aa8-80b5-2f0264c1626d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] <== disconnect_volume: return (363ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:08:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:08:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Deleting instance files /opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27_del
Jul 26 17:08:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Deletion of /opt/stack/data/nova/instances/fc2f6a06-3514-44fb-9391-fce3c1182e27_del complete
Jul 26 17:08:44 user nova-compute[70594]: INFO nova.compute.manager [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 26 17:08:44 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:08:44 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:08:44 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-changed-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Refreshing instance network info cache due to event network-changed-fd093a50-c11a-4ba5-b451-63176c04f7a8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] Acquiring lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] Acquired lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG nova.network.neutron [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Refreshing network info cache for port fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHRFSGEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:08:45 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:08:45 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:08:45 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4b558-3bb0-4b32-9f45-875b63bfa1fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:08:45 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a22605-c433-41ab-9427-a7913bb1b1ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f] added
Jul 26 17:08:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[355a5c8e-8c3e-4782-8c86-815750f0e4e5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff9955b-b333-401f-b1f0-1d151a06dade]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHRFSGEw {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHRFSGEw" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b2c2cf-e97d-40e4-9a39-2026d8a4ad3f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dHRFSGEw'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[46084218-2c44-4625-9911-4ec3ab2fac6b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a5602d-dc23-4607-a6d2-1edcf5166f94]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[59adf9a0-2b6a-4cba-b73c-668a79073d4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260]
Jul 26 17:08:45 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260] successful.
Jul 26 17:08:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04e0fd-e9ef-4a4a-a55e-d3d69cc7c937]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ac436-a745-4d4a-a996-e7b726b265d4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:45 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:08:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:45 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:08:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9023649-5438-4f24-b279-060507f2cfbc]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHRFSGEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:08:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:08:46 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:08:46 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Took 2.56 seconds to deallocate network for instance.
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updated VIF entry in instance network info cache for port fd093a50-c11a-4ba5-b451-63176c04f7a8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-151b0b99-2840-4aac-a64e-fd8eed838592 req-aad5cae9-d7b2-4948-ad11-3c7db15c5987 service nova] Releasing lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23338383436313763', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338383436313763', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.243s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:08:46 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:08:46 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'flavor' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52735825-f5c7-41ec-990f-e540f4758510]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:08:46 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:08:46 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:08:46 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:08:46 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:08:46 user nova-compute[70594]:   <serial>14216eeb-e0b3-47c2-b5f6-10496a11d60f</serial>
Jul 26 17:08:46 user nova-compute[70594]: </disk>
Jul 26 17:08:46 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f8aa2a-1d6e-4d72-99bf-f824e5582d3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63] added
Jul 26 17:08:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[936175d4-3702-4930-b183-8afd7351f37b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff7568-2be5-4cf7-941b-03f68008be1e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEixzaCS {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEixzaCS" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a367ed0-2dd4-4c99-8288-0e8ea54eec76]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEixzaCS'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f522d2f9-b76b-4fb8-9dd9-4f44e49f2de7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83f2d0-ffb2-49c7-b493-50bea7100184]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:47 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:08:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:47 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:08:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38470ccb-26da-4ddd-bb9f-b2eeca7ae4a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]
Jul 26 17:08:47 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.
Jul 26 17:08:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[601497e1-3a3e-4ef6-a82a-288825201b17]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-unplugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-unplugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-unplugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] Acquiring lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] No waiting events found dispatching network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:47 user nova-compute[70594]: WARNING nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received unexpected event network-vif-plugged-f21510ad-d95a-446c-af00-d2ec1a59754e for instance with vm_state active and task_state deleting.
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-533f8409-8257-4c8e-92b4-8a0af697c23f req-42e367e2-432f-4e6d-8393-791cbb6187e7 service nova] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Received event network-vif-deleted-f21510ad-d95a-446c-af00-d2ec1a59754e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1796dc-36ad-4d14-b3b0-bfc5809d0bef]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:47 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:08:47 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:08:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:08:47 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:08:47 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:08:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb4b358-bef2-4017-9698-51ea9cfcd571]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:b7:d6:90, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:08:47 user nova-compute[70594]: INFO nova.compute.manager [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Took 0.79 seconds to detach 1 volumes for instance.
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Deleting volume: 97b1271d-393d-49d8-9a17-cb7018f78fa5 {{(pid=70594) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8ce80910-df57-495e-9740-8f069c893336 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.789s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:08:47 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:48 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Deleted allocations for instance fc2f6a06-3514-44fb-9391-fce3c1182e27
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a32fed4-3f21-45df-8fd7-30e8b1443bff tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "fc2f6a06-3514-44fb-9391-fce3c1182e27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.505s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== connect_volume: return (1608ms) {'type': 'block', 'scsi_wwn': '23236346361356535', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236346361356535', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:08:48 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:08:48 user nova-compute[70594]:   <source dev="/dev/sdd"/>
Jul 26 17:08:48 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:08:48 user nova-compute[70594]:   <serial>b4233220-d3cd-4278-960b-5592325d5e63</serial>
Jul 26 17:08:48 user nova-compute[70594]: </disk>
Jul 26 17:08:48 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:08:48 user nova-compute[70594]: INFO nova.compute.manager [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Rescuing
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:08:48 user nova-compute[70594]: INFO nova.compute.claims [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Claim successful on node user
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No VIF found with MAC fa:16:3e:36:f4:ab, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:08:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9cc904c5-9e0d-4d65-8a4b-f447db74695a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.446s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.network.neutron [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:08:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.network.neutron [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.policy [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f600ead8c3664427adbe89df319bb29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4816177ff0e3447c93af8115e1fabcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:08:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Creating image(s)
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "/opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "/opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "/opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70594) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG nova.objects.instance [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.186s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk 1073741824" returned: 0 in 0.060s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-63bdf1d4-3761-44cc-9d76-6af5f2154933 req-52a83c8e-1d3a-4fa7-9760-d1385787d152 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-63bdf1d4-3761-44cc-9d76-6af5f2154933 req-52a83c8e-1d3a-4fa7-9760-d1385787d152 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-63bdf1d4-3761-44cc-9d76-6af5f2154933 req-52a83c8e-1d3a-4fa7-9760-d1385787d152 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-63bdf1d4-3761-44cc-9d76-6af5f2154933 req-52a83c8e-1d3a-4fa7-9760-d1385787d152 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-63bdf1d4-3761-44cc-9d76-6af5f2154933 req-52a83c8e-1d3a-4fa7-9760-d1385787d152 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:50 user nova-compute[70594]: WARNING nova.compute.manager [req-63bdf1d4-3761-44cc-9d76-6af5f2154933 req-52a83c8e-1d3a-4fa7-9760-d1385787d152 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state active and task_state powering-off.
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-d610e8d1-5e82-4b17-b495-9a9fe8776775 req-0b616819-aac5-48e8-a7b6-e335446da2c1 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d610e8d1-5e82-4b17-b495-9a9fe8776775 req-0b616819-aac5-48e8-a7b6-e335446da2c1 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d610e8d1-5e82-4b17-b495-9a9fe8776775 req-0b616819-aac5-48e8-a7b6-e335446da2c1 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d610e8d1-5e82-4b17-b495-9a9fe8776775 req-0b616819-aac5-48e8-a7b6-e335446da2c1 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-d610e8d1-5e82-4b17-b495-9a9fe8776775 req-0b616819-aac5-48e8-a7b6-e335446da2c1 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:50 user nova-compute[70594]: WARNING nova.compute.manager [req-d610e8d1-5e82-4b17-b495-9a9fe8776775 req-0b616819-aac5-48e8-a7b6-e335446da2c1 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state active and task_state rescuing.
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.189s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Cannot resize image /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'migration_context' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Ensure instance console log exists: /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance destroyed successfully.
Jul 26 17:08:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Attempting rescue
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70594) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:08:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Creating image(s)
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance destroyed successfully.
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-661e915f-014b-43c1-9158-34e6926ae537 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.206s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue" returned: 0 in 0.053s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'migration_context' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Start _get_guest_xml network_info=[{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:b7:d6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'resources' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-694281953',display_name='tempest-ServerRescueNegativeTestJSON-server-694281953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-694281953',id=26,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQyJw0+WuVC0dgS0L/dqS9Dx4JJ2YwhAgW8IpMVHEBgdmvIUcPFFddQF0iy5DrmLHXPWnbgRkKCOsxhvZyj/aID8CPZlV2RtBC39OTqabWPER9Yz3kSw+9xTF0CZEyF8Q==',key_name='tempest-keypair-268226951',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-adcayqe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=9c7ad527-efb9-4cec-8791-010b7a28eab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:b7:d6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "vif_mac": "fa:16:3e:b7:d6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:08:51 user nova-compute[70594]:   <uuid>9c7ad527-efb9-4cec-8791-010b7a28eab5</uuid>
Jul 26 17:08:51 user nova-compute[70594]:   <name>instance-0000001a</name>
Jul 26 17:08:51 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:08:51 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:08:51 user nova-compute[70594]:   <metadata>
Jul 26 17:08:51 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:08:51 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:08:51 user nova-compute[70594]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-694281953</nova:name>
Jul 26 17:08:51 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:08:51</nova:creationTime>
Jul 26 17:08:51 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:08:51 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:08:51 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:08:51 user nova-compute[70594]:       <nova:owner>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:user uuid="f5f5bd39056d4ebc973b6d8571a796ab">tempest-ServerRescueNegativeTestJSON-159727237-project-member</nova:user>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:project uuid="a2349e37642f4f4d9a3fe7b2c3d7a6c7">tempest-ServerRescueNegativeTestJSON-159727237</nova:project>
Jul 26 17:08:51 user nova-compute[70594]:       </nova:owner>
Jul 26 17:08:51 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:08:51 user nova-compute[70594]:       <nova:ports>
Jul 26 17:08:51 user nova-compute[70594]:         <nova:port uuid="0106bf37-b840-4629-81e8-a1df185a2cc2">
Jul 26 17:08:51 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:08:51 user nova-compute[70594]:         </nova:port>
Jul 26 17:08:51 user nova-compute[70594]:       </nova:ports>
Jul 26 17:08:51 user nova-compute[70594]:     </nova:instance>
Jul 26 17:08:51 user nova-compute[70594]:   </metadata>
Jul 26 17:08:51 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:08:51 user nova-compute[70594]:     <system>
Jul 26 17:08:51 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:08:51 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:08:51 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:08:51 user nova-compute[70594]:       <entry name="serial">9c7ad527-efb9-4cec-8791-010b7a28eab5</entry>
Jul 26 17:08:51 user nova-compute[70594]:       <entry name="uuid">9c7ad527-efb9-4cec-8791-010b7a28eab5</entry>
Jul 26 17:08:51 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:08:51 user nova-compute[70594]:     </system>
Jul 26 17:08:51 user nova-compute[70594]:   </sysinfo>
Jul 26 17:08:51 user nova-compute[70594]:   <os>
Jul 26 17:08:51 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:08:51 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:08:51 user nova-compute[70594]:   </os>
Jul 26 17:08:51 user nova-compute[70594]:   <features>
Jul 26 17:08:51 user nova-compute[70594]:     <acpi/>
Jul 26 17:08:51 user nova-compute[70594]:     <apic/>
Jul 26 17:08:51 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:08:51 user nova-compute[70594]:   </features>
Jul 26 17:08:51 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:08:51 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:08:51 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:08:51 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:08:51 user nova-compute[70594]:   </clock>
Jul 26 17:08:51 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:08:51 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:08:51 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:08:51 user nova-compute[70594]:   </cpu>
Jul 26 17:08:51 user nova-compute[70594]:   <devices>
Jul 26 17:08:51 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:08:51 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:08:51 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue"/>
Jul 26 17:08:51 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:08:51 user nova-compute[70594]:     </disk>
Jul 26 17:08:51 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:08:51 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:08:51 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk"/>
Jul 26 17:08:51 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:08:51 user nova-compute[70594]:     </disk>
Jul 26 17:08:51 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:08:51 user nova-compute[70594]:       <mac address="fa:16:3e:b7:d6:90"/>
Jul 26 17:08:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:51 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:08:51 user nova-compute[70594]:       <target dev="tap0106bf37-b8"/>
Jul 26 17:08:51 user nova-compute[70594]:     </interface>
Jul 26 17:08:51 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:08:51 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/console.log" append="off"/>
Jul 26 17:08:51 user nova-compute[70594]:     </serial>
Jul 26 17:08:51 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:08:51 user nova-compute[70594]:     <video>
Jul 26 17:08:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:51 user nova-compute[70594]:     </video>
Jul 26 17:08:51 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:08:51 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:08:51 user nova-compute[70594]:     </rng>
Jul 26 17:08:51 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:08:51 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:08:51 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:08:51 user nova-compute[70594]:     </memballoon>
Jul 26 17:08:51 user nova-compute[70594]:   </devices>
Jul 26 17:08:51 user nova-compute[70594]: </domain>
Jul 26 17:08:51 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:08:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance destroyed successfully.
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] No VIF found with MAC fa:16:3e:b7:d6:90, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Successfully created port: 17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-4807d0fd-5a4b-4f20-9335-0576a8b28aab req-35e7d6b2-00ab-4700-a33b-aa7d7ccc3c70 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4807d0fd-5a4b-4f20-9335-0576a8b28aab req-35e7d6b2-00ab-4700-a33b-aa7d7ccc3c70 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4807d0fd-5a4b-4f20-9335-0576a8b28aab req-35e7d6b2-00ab-4700-a33b-aa7d7ccc3c70 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4807d0fd-5a4b-4f20-9335-0576a8b28aab req-35e7d6b2-00ab-4700-a33b-aa7d7ccc3c70 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-4807d0fd-5a4b-4f20-9335-0576a8b28aab req-35e7d6b2-00ab-4700-a33b-aa7d7ccc3c70 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:52 user nova-compute[70594]: WARNING nova.compute.manager [req-4807d0fd-5a4b-4f20-9335-0576a8b28aab req-35e7d6b2-00ab-4700-a33b-aa7d7ccc3c70 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state stopped and task_state None.
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-b18f5996-f4e5-49c6-b405-4b687ebc2a2a req-d00c21d6-90cc-448b-a91b-ebfe3d4c4f2e service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b18f5996-f4e5-49c6-b405-4b687ebc2a2a req-d00c21d6-90cc-448b-a91b-ebfe3d4c4f2e service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b18f5996-f4e5-49c6-b405-4b687ebc2a2a req-d00c21d6-90cc-448b-a91b-ebfe3d4c4f2e service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b18f5996-f4e5-49c6-b405-4b687ebc2a2a req-d00c21d6-90cc-448b-a91b-ebfe3d4c4f2e service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-b18f5996-f4e5-49c6-b405-4b687ebc2a2a req-d00c21d6-90cc-448b-a91b-ebfe3d4c4f2e service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:52 user nova-compute[70594]: WARNING nova.compute.manager [req-b18f5996-f4e5-49c6-b405-4b687ebc2a2a req-d00c21d6-90cc-448b-a91b-ebfe3d4c4f2e service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state active and task_state rescuing.
Jul 26 17:08:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.network.neutron [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Successfully updated port: 17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquired lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.network.neutron [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-changed-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Refreshing instance network info cache due to event network-changed-17dbf405-7f7b-4583-8d0a-0b000757a47d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] Acquiring lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:52 user nova-compute[70594]: DEBUG nova.network.neutron [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.network.neutron [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating instance_info_cache with network_info: [{"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Releasing lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Instance network_info: |[{"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] Acquired lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Refreshing network info cache for port 17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Start _get_guest_xml network_info=[{"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:08:53 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:53 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1931141150',display_name='tempest-SnapshotDataIntegrityTests-server-1931141150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1931141150',id=30,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKivwAgBNSfRn37eyRiOmILDe6uC7rsYMQ8LHxuo24HsfP+HkSgIxTljPn45XH5HN8VhsPL6Gsgz+OAcn2fL1/lyAdIXMuAjEltdLJZwGnlhm7LAATupDtGu07JrfUUzZQ==',key_name='tempest-keypair-2073314163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4816177ff0e3447c93af8115e1fabcb7',ramdisk_id='',reservation_id='r-h8cz4yi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-174874440',owner_user_name='tempest-SnapshotDataIntegrityTests-174874440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600ead8c3664427adbe89df319bb29c',uuid=618adbc0-feb7-4fdf-99f2-49ea967ab92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Converting VIF {"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.objects.instance [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'pci_devices' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:08:53 user nova-compute[70594]:   <uuid>618adbc0-feb7-4fdf-99f2-49ea967ab92d</uuid>
Jul 26 17:08:53 user nova-compute[70594]:   <name>instance-0000001e</name>
Jul 26 17:08:53 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:08:53 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:08:53 user nova-compute[70594]:   <metadata>
Jul 26 17:08:53 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:08:53 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:08:53 user nova-compute[70594]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1931141150</nova:name>
Jul 26 17:08:53 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:08:53</nova:creationTime>
Jul 26 17:08:53 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:08:53 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:08:53 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:08:53 user nova-compute[70594]:       <nova:owner>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:user uuid="f600ead8c3664427adbe89df319bb29c">tempest-SnapshotDataIntegrityTests-174874440-project-member</nova:user>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:project uuid="4816177ff0e3447c93af8115e1fabcb7">tempest-SnapshotDataIntegrityTests-174874440</nova:project>
Jul 26 17:08:53 user nova-compute[70594]:       </nova:owner>
Jul 26 17:08:53 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:08:53 user nova-compute[70594]:       <nova:ports>
Jul 26 17:08:53 user nova-compute[70594]:         <nova:port uuid="17dbf405-7f7b-4583-8d0a-0b000757a47d">
Jul 26 17:08:53 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:08:53 user nova-compute[70594]:         </nova:port>
Jul 26 17:08:53 user nova-compute[70594]:       </nova:ports>
Jul 26 17:08:53 user nova-compute[70594]:     </nova:instance>
Jul 26 17:08:53 user nova-compute[70594]:   </metadata>
Jul 26 17:08:53 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:08:53 user nova-compute[70594]:     <system>
Jul 26 17:08:53 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:08:53 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:08:53 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:08:53 user nova-compute[70594]:       <entry name="serial">618adbc0-feb7-4fdf-99f2-49ea967ab92d</entry>
Jul 26 17:08:53 user nova-compute[70594]:       <entry name="uuid">618adbc0-feb7-4fdf-99f2-49ea967ab92d</entry>
Jul 26 17:08:53 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:08:53 user nova-compute[70594]:     </system>
Jul 26 17:08:53 user nova-compute[70594]:   </sysinfo>
Jul 26 17:08:53 user nova-compute[70594]:   <os>
Jul 26 17:08:53 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:08:53 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:08:53 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:08:53 user nova-compute[70594]:   </os>
Jul 26 17:08:53 user nova-compute[70594]:   <features>
Jul 26 17:08:53 user nova-compute[70594]:     <acpi/>
Jul 26 17:08:53 user nova-compute[70594]:     <apic/>
Jul 26 17:08:53 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:08:53 user nova-compute[70594]:   </features>
Jul 26 17:08:53 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:08:53 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:08:53 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:08:53 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:08:53 user nova-compute[70594]:   </clock>
Jul 26 17:08:53 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:08:53 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:08:53 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:08:53 user nova-compute[70594]:   </cpu>
Jul 26 17:08:53 user nova-compute[70594]:   <devices>
Jul 26 17:08:53 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:08:53 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:08:53 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk"/>
Jul 26 17:08:53 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:08:53 user nova-compute[70594]:     </disk>
Jul 26 17:08:53 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:08:53 user nova-compute[70594]:       <mac address="fa:16:3e:b1:73:53"/>
Jul 26 17:08:53 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:53 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:08:53 user nova-compute[70594]:       <target dev="tap17dbf405-7f"/>
Jul 26 17:08:53 user nova-compute[70594]:     </interface>
Jul 26 17:08:53 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:08:53 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/console.log" append="off"/>
Jul 26 17:08:53 user nova-compute[70594]:     </serial>
Jul 26 17:08:53 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:08:53 user nova-compute[70594]:     <video>
Jul 26 17:08:53 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:08:53 user nova-compute[70594]:     </video>
Jul 26 17:08:53 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:08:53 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:08:53 user nova-compute[70594]:     </rng>
Jul 26 17:08:53 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:08:53 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:08:53 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:08:53 user nova-compute[70594]:     </memballoon>
Jul 26 17:08:53 user nova-compute[70594]:   </devices>
Jul 26 17:08:53 user nova-compute[70594]: </domain>
Jul 26 17:08:53 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1931141150',display_name='tempest-SnapshotDataIntegrityTests-server-1931141150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1931141150',id=30,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKivwAgBNSfRn37eyRiOmILDe6uC7rsYMQ8LHxuo24HsfP+HkSgIxTljPn45XH5HN8VhsPL6Gsgz+OAcn2fL1/lyAdIXMuAjEltdLJZwGnlhm7LAATupDtGu07JrfUUzZQ==',key_name='tempest-keypair-2073314163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4816177ff0e3447c93af8115e1fabcb7',ramdisk_id='',reservation_id='r-h8cz4yi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-174874440',owner_user_name='tempest-SnapshotDataIntegrityTests-174874440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600ead8c3664427adbe89df319bb29c',uuid=618adbc0-feb7-4fdf-99f2-49ea967ab92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Converting VIF {"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG os_vif [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17dbf405-7f, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17dbf405-7f, col_values=(('external_ids', {'iface-id': '17dbf405-7f7b-4583-8d0a-0b000757a47d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:73:53', 'vm-uuid': '618adbc0-feb7-4fdf-99f2-49ea967ab92d'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:53 user nova-compute[70594]: INFO os_vif [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f')
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:08:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No VIF found with MAC fa:16:3e:b1:73:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updated VIF entry in instance network info cache for port 17dbf405-7f7b-4583-8d0a-0b000757a47d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating instance_info_cache with network_info: [{"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f83068c-e99c-41f7-9a38-ea52eca1e00c req-b459e8e0-3b86-44e9-8cdb-de0043278e91 service nova] Releasing lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:54 user nova-compute[70594]: WARNING nova.compute.manager [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state active and task_state rescuing.
Jul 26 17:08:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:54 user nova-compute[70594]: WARNING nova.compute.manager [req-c62fd0e7-f56d-47d1-9e1a-312b32d99f73 req-626be61a-fd8f-4a8f-b6b7-3e8a029b9999 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state active and task_state rescuing.
Jul 26 17:08:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 9c7ad527-efb9-4cec-8791-010b7a28eab5 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391335.0173378, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Resumed (Lifecycle Event)
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-86261c61-2799-4808-a3b5-9339fef4e49f tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391335.034138, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Started (Lifecycle Event)
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-6c824398-0f75-4b0f-a545-35706d7d536b req-e5c0f1e4-8a4a-4874-b9f7-dab8abc7bdef service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6c824398-0f75-4b0f-a545-35706d7d536b req-e5c0f1e4-8a4a-4874-b9f7-dab8abc7bdef service nova] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6c824398-0f75-4b0f-a545-35706d7d536b req-e5c0f1e4-8a4a-4874-b9f7-dab8abc7bdef service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6c824398-0f75-4b0f-a545-35706d7d536b req-e5c0f1e4-8a4a-4874-b9f7-dab8abc7bdef service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-6c824398-0f75-4b0f-a545-35706d7d536b req-e5c0f1e4-8a4a-4874-b9f7-dab8abc7bdef service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] No waiting events found dispatching network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:55 user nova-compute[70594]: WARNING nova.compute.manager [req-6c824398-0f75-4b0f-a545-35706d7d536b req-e5c0f1e4-8a4a-4874-b9f7-dab8abc7bdef service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received unexpected event network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d for instance with vm_state building and task_state spawning.
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-b76e47da-d061-4453-b7ed-27e97360d16d req-85e3e3b6-da73-4ae3-8f1e-b6cefee948ba service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b76e47da-d061-4453-b7ed-27e97360d16d req-85e3e3b6-da73-4ae3-8f1e-b6cefee948ba service nova] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b76e47da-d061-4453-b7ed-27e97360d16d req-85e3e3b6-da73-4ae3-8f1e-b6cefee948ba service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b76e47da-d061-4453-b7ed-27e97360d16d req-85e3e3b6-da73-4ae3-8f1e-b6cefee948ba service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-b76e47da-d061-4453-b7ed-27e97360d16d req-85e3e3b6-da73-4ae3-8f1e-b6cefee948ba service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] No waiting events found dispatching network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:08:57 user nova-compute[70594]: WARNING nova.compute.manager [req-b76e47da-d061-4453-b7ed-27e97360d16d req-85e3e3b6-da73-4ae3-8f1e-b6cefee948ba service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received unexpected event network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d for instance with vm_state building and task_state spawning.
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391337.3330832, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] VM Resumed (Lifecycle Event)
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Instance spawned successfully.
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391337.333178, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] VM Started (Lifecycle Event)
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Took 7.99 seconds to spawn the instance on the hypervisor.
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:08:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:08:57 user nova-compute[70594]: INFO nova.compute.manager [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Took 8.93 seconds to build instance.
Jul 26 17:08:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-eb684911-1714-413d-af96-9fd46b9e289a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.025s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:08:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:08:58 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391323.5385678, fc2f6a06-3514-44fb-9391-fce3c1182e27 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:08:58 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] VM Stopped (Lifecycle Event)
Jul 26 17:08:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8a2a89da-e68f-468f-89b0-cd1fe2eab3d2 None None] [instance: fc2f6a06-3514-44fb-9391-fce3c1182e27] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:01 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:03 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:04 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391330.6323051, 35205a75-e9a7-49a5-96f8-57631680ca05 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:09:05 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Stopped (Lifecycle Event)
Jul 26 17:09:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-cfe0da8a-26bf-4db3-b035-cda073d9fa5e None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-cfe0da8a-26bf-4db3-b035-cda073d9fa5e None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:09 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:09:09 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=25.214405059814453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 60c4b302-f745-4b4c-8462-258338fcb0fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f6206aea-d091-4f94-97cc-bb940e53a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 17:09:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.995s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:09:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updating instance_info_cache with network_info: [{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:09:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:09:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:09:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:09:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:09:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:09:20 user nova-compute[70594]: INFO nova.compute.claims [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Claim successful on node user
Jul 26 17:09:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:09:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:09:21 user nova-compute[70594]: INFO nova.virt.block_device [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Booting with volume 714be488-518b-47e6-addb-15122230f336 at /dev/vda
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.policy [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59ec9b7626b3434ca0a3b14075902993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7f2f383f3f49f89a60c1d12e7e0102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG os_brick.utils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[494796f7-efaa-4362-bc05-9811caeb0d2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a6a11d-3c47-4797-a63a-c59b8a0ce198]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0678a26-e136-405c-85b2-c56bdd1e8c8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d6a1dd-22fc-48ab-9272-b2f9c35d1a81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:09:21 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:09:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a79619-d6be-4f7c-ba91-70f764fdcc0a]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG os_brick.utils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:09:21 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating existing volume attachment record: 1e45842b-d88e-466a-9f51-70af39e5dd87 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:09:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Successfully created port: 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Successfully updated port: 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing instance network info cache due to event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance network_info: |[{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:09:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:09:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updated VIF entry in instance network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:09:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:09:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-21e480a3-fb86-4afe-a412-938f89033021 req-54203da7-4128-40d7-ba7b-fd0e8e3bade2 service nova] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:09:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:09:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Creating image(s)
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Ensure instance console log exists: /opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Start _get_guest_xml network_info=[{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '636d93f0-fdb5-46bc-8835-d35298ad7afb', 'attached_at': '', 'detached_at': '', 'volume_id': '714be488-518b-47e6-addb-15122230f336', 'serial': '714be488-518b-47e6-addb-15122230f336'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '1e45842b-d88e-466a-9f51-70af39e5dd87', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:09:28 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:09:28 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:09:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:09:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:09:28 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1dd6c5-c8a1-4e49-87b6-9d9ad57d9f2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:09:28 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e99eed-c602-4ab6-952d-7bd30ef147ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336] added
Jul 26 17:09:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a63b05-6b65-48df-bad8-70545f02524a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02736d0a-ce43-4909-920e-86a35cdc2671]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmBQihHp {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmBQihHp" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa44099d-198f-4655-bdd0-3eee6403c0d6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmBQihHp'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5be1d9a-660d-4b64-b779-77cc53931024]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0599b299-865c-4a86-9166-2260a945025e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1416f892-2078-45f5-b765-b02814667713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]
Jul 26 17:09:29 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.
Jul 26 17:09:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2d7e9d-ced3-4d0b-982b-84d7901cafed]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccbeda9-dbd2-4316-b7ae-40434bf71bab]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:09:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[836faa42-5df1-47c6-862a-0e75999b9198]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:09:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23839313232333634', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839313232333634', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1924341254',display_name='tempest-TestShelveInstance-server-1924341254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1924341254',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD711OgGvL8zsvkRnXwJ85qTyJEzM/jz9LEhghOi0M8kOEyRHFIeZT7VGCqv0lS8aw7Jha3PuCpybuEhuzP6uNrqPTLg7BfaX9h4TOz2kmXmlcqBdO/hTis4D7HMyCA1pw==',key_name='tempest-TestShelveInstance-284998996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7f2f383f3f49f89a60c1d12e7e0102',ramdisk_id='',reservation_id='r-0ksxqzxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-448703386',owner_user_name='tempest-TestShelveInstance-448703386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:09:22Z,user_data=None,user_id='59ec9b7626b3434ca0a3b14075902993',uuid=636d93f0-fdb5-46bc-8835-d35298ad7afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converting VIF {"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'pci_devices' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:09:30 user nova-compute[70594]:   <uuid>636d93f0-fdb5-46bc-8835-d35298ad7afb</uuid>
Jul 26 17:09:30 user nova-compute[70594]:   <name>instance-0000001f</name>
Jul 26 17:09:30 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:09:30 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:09:30 user nova-compute[70594]:   <metadata>
Jul 26 17:09:30 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:09:30 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:09:30 user nova-compute[70594]:       <nova:name>tempest-TestShelveInstance-server-1924341254</nova:name>
Jul 26 17:09:30 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:09:28</nova:creationTime>
Jul 26 17:09:30 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:09:30 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:09:30 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:09:30 user nova-compute[70594]:       <nova:owner>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:user uuid="59ec9b7626b3434ca0a3b14075902993">tempest-TestShelveInstance-448703386-project-member</nova:user>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:project uuid="5c7f2f383f3f49f89a60c1d12e7e0102">tempest-TestShelveInstance-448703386</nova:project>
Jul 26 17:09:30 user nova-compute[70594]:       </nova:owner>
Jul 26 17:09:30 user nova-compute[70594]:       <nova:ports>
Jul 26 17:09:30 user nova-compute[70594]:         <nova:port uuid="8a2bebe0-90e3-4160-a03d-f8548a907a0f">
Jul 26 17:09:30 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:09:30 user nova-compute[70594]:         </nova:port>
Jul 26 17:09:30 user nova-compute[70594]:       </nova:ports>
Jul 26 17:09:30 user nova-compute[70594]:     </nova:instance>
Jul 26 17:09:30 user nova-compute[70594]:   </metadata>
Jul 26 17:09:30 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:09:30 user nova-compute[70594]:     <system>
Jul 26 17:09:30 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:09:30 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:09:30 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:09:30 user nova-compute[70594]:       <entry name="serial">636d93f0-fdb5-46bc-8835-d35298ad7afb</entry>
Jul 26 17:09:30 user nova-compute[70594]:       <entry name="uuid">636d93f0-fdb5-46bc-8835-d35298ad7afb</entry>
Jul 26 17:09:30 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:09:30 user nova-compute[70594]:     </system>
Jul 26 17:09:30 user nova-compute[70594]:   </sysinfo>
Jul 26 17:09:30 user nova-compute[70594]:   <os>
Jul 26 17:09:30 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:09:30 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:09:30 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:09:30 user nova-compute[70594]:   </os>
Jul 26 17:09:30 user nova-compute[70594]:   <features>
Jul 26 17:09:30 user nova-compute[70594]:     <acpi/>
Jul 26 17:09:30 user nova-compute[70594]:     <apic/>
Jul 26 17:09:30 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:09:30 user nova-compute[70594]:   </features>
Jul 26 17:09:30 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:09:30 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:09:30 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:09:30 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:09:30 user nova-compute[70594]:   </clock>
Jul 26 17:09:30 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:09:30 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:09:30 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:09:30 user nova-compute[70594]:   </cpu>
Jul 26 17:09:30 user nova-compute[70594]:   <devices>
Jul 26 17:09:30 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:09:30 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:09:30 user nova-compute[70594]:       <source dev="/dev/sde"/>
Jul 26 17:09:30 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:09:30 user nova-compute[70594]:       <serial>714be488-518b-47e6-addb-15122230f336</serial>
Jul 26 17:09:30 user nova-compute[70594]:     </disk>
Jul 26 17:09:30 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:09:30 user nova-compute[70594]:       <mac address="fa:16:3e:7c:1c:93"/>
Jul 26 17:09:30 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:09:30 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:09:30 user nova-compute[70594]:       <target dev="tap8a2bebe0-90"/>
Jul 26 17:09:30 user nova-compute[70594]:     </interface>
Jul 26 17:09:30 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:09:30 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb/console.log" append="off"/>
Jul 26 17:09:30 user nova-compute[70594]:     </serial>
Jul 26 17:09:30 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:09:30 user nova-compute[70594]:     <video>
Jul 26 17:09:30 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:09:30 user nova-compute[70594]:     </video>
Jul 26 17:09:30 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:09:30 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:09:30 user nova-compute[70594]:     </rng>
Jul 26 17:09:30 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:09:30 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:09:30 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:09:30 user nova-compute[70594]:     </memballoon>
Jul 26 17:09:30 user nova-compute[70594]:   </devices>
Jul 26 17:09:30 user nova-compute[70594]: </domain>
Jul 26 17:09:30 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1924341254',display_name='tempest-TestShelveInstance-server-1924341254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1924341254',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD711OgGvL8zsvkRnXwJ85qTyJEzM/jz9LEhghOi0M8kOEyRHFIeZT7VGCqv0lS8aw7Jha3PuCpybuEhuzP6uNrqPTLg7BfaX9h4TOz2kmXmlcqBdO/hTis4D7HMyCA1pw==',key_name='tempest-TestShelveInstance-284998996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7f2f383f3f49f89a60c1d12e7e0102',ramdisk_id='',reservation_id='r-0ksxqzxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-448703386',owner_user_name='tempest-TestShelveInstance-448703386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:09:22Z,user_data=None,user_id='59ec9b7626b3434ca0a3b14075902993',uuid=636d93f0-fdb5-46bc-8835-d35298ad7afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converting VIF {"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG os_vif [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a2bebe0-90, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a2bebe0-90, col_values=(('external_ids', {'iface-id': '8a2bebe0-90e3-4160-a03d-f8548a907a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:1c:93', 'vm-uuid': '636d93f0-fdb5-46bc-8835-d35298ad7afb'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:30 user nova-compute[70594]: INFO os_vif [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90')
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:09:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] No VIF found with MAC fa:16:3e:7c:1c:93, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f2d72b9-7e04-47a0-8f0a-c77872580019 req-542dacf7-0679-4962-92e0-fa9a499dfd32 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f2d72b9-7e04-47a0-8f0a-c77872580019 req-542dacf7-0679-4962-92e0-fa9a499dfd32 service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f2d72b9-7e04-47a0-8f0a-c77872580019 req-542dacf7-0679-4962-92e0-fa9a499dfd32 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4f2d72b9-7e04-47a0-8f0a-c77872580019 req-542dacf7-0679-4962-92e0-fa9a499dfd32 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:31 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f2d72b9-7e04-47a0-8f0a-c77872580019 req-542dacf7-0679-4962-92e0-fa9a499dfd32 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:09:31 user nova-compute[70594]: WARNING nova.compute.manager [req-4f2d72b9-7e04-47a0-8f0a-c77872580019 req-542dacf7-0679-4962-92e0-fa9a499dfd32 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state building and task_state spawning.
Jul 26 17:09:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-f39aecc9-0d41-42bc-a533-0b68c01061b9 req-62a11c97-6122-4dcb-8c76-1b19a1b1195b service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f39aecc9-0d41-42bc-a533-0b68c01061b9 req-62a11c97-6122-4dcb-8c76-1b19a1b1195b service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f39aecc9-0d41-42bc-a533-0b68c01061b9 req-62a11c97-6122-4dcb-8c76-1b19a1b1195b service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f39aecc9-0d41-42bc-a533-0b68c01061b9 req-62a11c97-6122-4dcb-8c76-1b19a1b1195b service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-f39aecc9-0d41-42bc-a533-0b68c01061b9 req-62a11c97-6122-4dcb-8c76-1b19a1b1195b service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:09:33 user nova-compute[70594]: WARNING nova.compute.manager [req-f39aecc9-0d41-42bc-a533-0b68c01061b9 req-62a11c97-6122-4dcb-8c76-1b19a1b1195b service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state building and task_state spawning.
Jul 26 17:09:33 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391373.9787464, 636d93f0-fdb5-46bc-8835-d35298ad7afb => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:09:33 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] VM Resumed (Lifecycle Event)
Jul 26 17:09:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:09:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:09:33 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance spawned successfully.
Jul 26 17:09:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391373.9810612, 636d93f0-fdb5-46bc-8835-d35298ad7afb => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] VM Started (Lifecycle Event)
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Took 5.33 seconds to spawn the instance on the hypervisor.
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Took 13.31 seconds to build instance.
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b741e470-64f2-4511-bf8f-7a9731aef1f1 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.413s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Unshelving
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.manager [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Terminating instance
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.objects.instance [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'pci_requests' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.objects.instance [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'numa_topology' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:09:34 user nova-compute[70594]: INFO nova.compute.claims [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Claim successful on node user
Jul 26 17:09:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8f9e830a-3136-42e3-a574-c5c1b01a8afd req-a0a17a04-44cb-4efd-8048-02a5bf549209 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-vif-unplugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8f9e830a-3136-42e3-a574-c5c1b01a8afd req-a0a17a04-44cb-4efd-8048-02a5bf549209 service nova] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8f9e830a-3136-42e3-a574-c5c1b01a8afd req-a0a17a04-44cb-4efd-8048-02a5bf549209 service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8f9e830a-3136-42e3-a574-c5c1b01a8afd req-a0a17a04-44cb-4efd-8048-02a5bf549209 service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8f9e830a-3136-42e3-a574-c5c1b01a8afd req-a0a17a04-44cb-4efd-8048-02a5bf549209 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] No waiting events found dispatching network-vif-unplugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-8f9e830a-3136-42e3-a574-c5c1b01a8afd req-a0a17a04-44cb-4efd-8048-02a5bf549209 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-vif-unplugged-402aafc0-cc42-483f-8bea-81d9184e537e for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:09:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Instance destroyed successfully.
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.objects.instance [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lazy-loading 'resources' on Instance uuid 60c4b302-f745-4b4c-8462-258338fcb0fe {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1135721985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1135721985',id=19,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+tJo+xie//py0ysaODxNFuqBpFph4h3PGRHlWFPlZoGuXnMh4n5oxv0LGSWUqnbqDE1Lm5dM9OyWq7IuLRwxw9QaPGe7NCJtl5fXWDqAq3Xr4fGcFJnuGA+2jcHHNC2Q==',key_name='tempest-keypair-783037101',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c75af562500b4c6a8586de2079994e90',ramdisk_id='',reservation_id='r-wniyzd29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-607585814',owner_user_name='tempest-ServerActionsV293TestJSON-607585814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f042f51e92ac400ea26bce166a410123',uuid=60c4b302-f745-4b4c-8462-258338fcb0fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converting VIF {"id": "402aafc0-cc42-483f-8bea-81d9184e537e", "address": "fa:16:3e:d9:06:f5", "network": {"id": "0916cbbf-4cdd-42cc-8070-c0f89efcb280", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-699082773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75af562500b4c6a8586de2079994e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402aafc0-cc", "ovs_interfaceid": "402aafc0-cc42-483f-8bea-81d9184e537e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG os_vif [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap402aafc0-cc, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:35 user nova-compute[70594]: INFO os_vif [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:06:f5,bridge_name='br-int',has_traffic_filtering=True,id=402aafc0-cc42-483f-8bea-81d9184e537e,network=Network(0916cbbf-4cdd-42cc-8070-c0f89efcb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402aafc0-cc')
Jul 26 17:09:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Deleting instance files /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe_del
Jul 26 17:09:35 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Deletion of /opt/stack/data/nova/instances/60c4b302-f745-4b4c-8462-258338fcb0fe_del complete
Jul 26 17:09:35 user nova-compute[70594]: INFO nova.network.neutron [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating port a89a2f0d-bff5-44b5-a17a-d5037afa4f05 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 26 17:09:35 user nova-compute[70594]: INFO nova.compute.manager [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 26 17:09:35 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:09:35 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:09:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-96d0ac8e-1f88-4f1d-9848-84948eae85f9 req-ce1b0964-5e66-4471-9fd2-53adda3c7785 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-96d0ac8e-1f88-4f1d-9848-84948eae85f9 req-ce1b0964-5e66-4471-9fd2-53adda3c7785 service nova] Acquiring lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-96d0ac8e-1f88-4f1d-9848-84948eae85f9 req-ce1b0964-5e66-4471-9fd2-53adda3c7785 service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-96d0ac8e-1f88-4f1d-9848-84948eae85f9 req-ce1b0964-5e66-4471-9fd2-53adda3c7785 service nova] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-96d0ac8e-1f88-4f1d-9848-84948eae85f9 req-ce1b0964-5e66-4471-9fd2-53adda3c7785 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] No waiting events found dispatching network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:09:37 user nova-compute[70594]: WARNING nova.compute.manager [req-96d0ac8e-1f88-4f1d-9848-84948eae85f9 req-ce1b0964-5e66-4471-9fd2-53adda3c7785 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received unexpected event network-vif-plugged-402aafc0-cc42-483f-8bea-81d9184e537e for instance with vm_state active and task_state deleting.
Jul 26 17:09:37 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:09:37 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Took 1.85 seconds to deallocate network for instance.
Jul 26 17:09:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-13a097e2-8fa7-4fa2-9430-b8e186d963bc req-9bbd8c86-262c-4db9-adb6-f2b285c15658 service nova] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Received event network-vif-deleted-402aafc0-cc42-483f-8bea-81d9184e537e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG nova.network.neutron [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:38 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Deleted allocations for instance 60c4b302-f745-4b4c-8462-258338fcb0fe
Jul 26 17:09:38 user nova-compute[70594]: DEBUG nova.network.neutron [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:09:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Creating image(s)
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'trusted_certs' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "fe5c82e2e29fa2631140efbfb7a4e082a977d5eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "fe5c82e2e29fa2631140efbfb7a4e082a977d5eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4c2a738e-2bb5-412a-9b29-53f5beb9550e tempest-ServerActionsV293TestJSON-607585814 tempest-ServerActionsV293TestJSON-607585814-project-member] Lock "60c4b302-f745-4b4c-8462-258338fcb0fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.625s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.part --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG nova.virt.images [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] 3ba5d89a-2b38-4460-9936-80f7c426522b was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.part /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.part /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.converted" returned: 0 in 0.191s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing instance network info cache due to event network-changed-a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Refreshing network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "fe5c82e2e29fa2631140efbfb7a4e082a977d5eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.383s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "fe5c82e2e29fa2631140efbfb7a4e082a977d5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "fe5c82e2e29fa2631140efbfb7a4e082a977d5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb,backing_fmt=raw /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb,backing_fmt=raw /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk 1073741824" returned: 0 in 0.052s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "fe5c82e2e29fa2631140efbfb7a4e082a977d5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe5c82e2e29fa2631140efbfb7a4e082a977d5eb --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'migration_context' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:40 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Rebasing disk image.
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG nova.network.neutron [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updated VIF entry in instance network info cache for port a89a2f0d-bff5-44b5-a17a-d5037afa4f05. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG nova.network.neutron [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a27b32e2-2e56-4e6a-b053-b6eaec47352d req-85d2d26d-eac1-4750-b632-369cc38ceb1a service nova] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b -F raw /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:09:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b -F raw /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk" returned: 0 in 2.303s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Ensure instance console log exists: /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Start _get_guest_xml network_info=[{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8306e33ca9915b8aefeff027d75a8a19',container_format='bare',created_at=2023-07-26T17:07:41Z,direct_url=<?>,disk_format='qcow2',id=3ba5d89a-2b38-4460-9936-80f7c426522b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-971400957-shelved',owner='f389f41a191747e68ceeb776fdcbff40',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-26T17:07:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:09:42 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:09:42 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8306e33ca9915b8aefeff027d75a8a19',container_format='bare',created_at=2023-07-26T17:07:41Z,direct_url=<?>,disk_format='qcow2',id=3ba5d89a-2b38-4460-9936-80f7c426522b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-971400957-shelved',owner='f389f41a191747e68ceeb776fdcbff40',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-26T17:07:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'vcpu_model' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-971400957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-971400957',id=24,image_ref='3ba5d89a-2b38-4460-9936-80f7c426522b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1944995380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-1rhi3h8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member',shelved_at='2023-07-26T17:07:45.419604',shelved_host='user',shelved_image_id='3ba5d89a-2b38-4460-9936-80f7c426522b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:09:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=572dfc14-2bf8-4947-9396-63cd364ccf39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'pci_devices' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:09:42 user nova-compute[70594]:   <uuid>572dfc14-2bf8-4947-9396-63cd364ccf39</uuid>
Jul 26 17:09:42 user nova-compute[70594]:   <name>instance-00000018</name>
Jul 26 17:09:42 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:09:42 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:09:42 user nova-compute[70594]:   <metadata>
Jul 26 17:09:42 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:09:42 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:09:42 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-971400957</nova:name>
Jul 26 17:09:42 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:09:42</nova:creationTime>
Jul 26 17:09:42 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:09:42 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:09:42 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:09:42 user nova-compute[70594]:       <nova:owner>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:user uuid="e9714a3b9e9d44f6b22c49d3d495d7ad">tempest-AttachVolumeShelveTestJSON-1781489687-project-member</nova:user>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:project uuid="f389f41a191747e68ceeb776fdcbff40">tempest-AttachVolumeShelveTestJSON-1781489687</nova:project>
Jul 26 17:09:42 user nova-compute[70594]:       </nova:owner>
Jul 26 17:09:42 user nova-compute[70594]:       <nova:root type="image" uuid="3ba5d89a-2b38-4460-9936-80f7c426522b"/>
Jul 26 17:09:42 user nova-compute[70594]:       <nova:ports>
Jul 26 17:09:42 user nova-compute[70594]:         <nova:port uuid="a89a2f0d-bff5-44b5-a17a-d5037afa4f05">
Jul 26 17:09:42 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:09:42 user nova-compute[70594]:         </nova:port>
Jul 26 17:09:42 user nova-compute[70594]:       </nova:ports>
Jul 26 17:09:42 user nova-compute[70594]:     </nova:instance>
Jul 26 17:09:42 user nova-compute[70594]:   </metadata>
Jul 26 17:09:42 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:09:42 user nova-compute[70594]:     <system>
Jul 26 17:09:42 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:09:42 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:09:42 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:09:42 user nova-compute[70594]:       <entry name="serial">572dfc14-2bf8-4947-9396-63cd364ccf39</entry>
Jul 26 17:09:42 user nova-compute[70594]:       <entry name="uuid">572dfc14-2bf8-4947-9396-63cd364ccf39</entry>
Jul 26 17:09:42 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:09:42 user nova-compute[70594]:     </system>
Jul 26 17:09:42 user nova-compute[70594]:   </sysinfo>
Jul 26 17:09:42 user nova-compute[70594]:   <os>
Jul 26 17:09:42 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:09:42 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:09:42 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:09:42 user nova-compute[70594]:   </os>
Jul 26 17:09:42 user nova-compute[70594]:   <features>
Jul 26 17:09:42 user nova-compute[70594]:     <acpi/>
Jul 26 17:09:42 user nova-compute[70594]:     <apic/>
Jul 26 17:09:42 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:09:42 user nova-compute[70594]:   </features>
Jul 26 17:09:42 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:09:42 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:09:42 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:09:42 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:09:42 user nova-compute[70594]:   </clock>
Jul 26 17:09:42 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:09:42 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:09:42 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:09:42 user nova-compute[70594]:   </cpu>
Jul 26 17:09:42 user nova-compute[70594]:   <devices>
Jul 26 17:09:42 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:09:42 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:09:42 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk"/>
Jul 26 17:09:42 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:09:42 user nova-compute[70594]:     </disk>
Jul 26 17:09:42 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:09:42 user nova-compute[70594]:       <mac address="fa:16:3e:19:72:22"/>
Jul 26 17:09:42 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:09:42 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:09:42 user nova-compute[70594]:       <target dev="tapa89a2f0d-bf"/>
Jul 26 17:09:42 user nova-compute[70594]:     </interface>
Jul 26 17:09:42 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:09:42 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/console.log" append="off"/>
Jul 26 17:09:42 user nova-compute[70594]:     </serial>
Jul 26 17:09:42 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:09:42 user nova-compute[70594]:     <video>
Jul 26 17:09:42 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:09:42 user nova-compute[70594]:     </video>
Jul 26 17:09:42 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:09:42 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:09:42 user nova-compute[70594]:     </rng>
Jul 26 17:09:42 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:09:42 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:09:42 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:09:42 user nova-compute[70594]:     </memballoon>
Jul 26 17:09:42 user nova-compute[70594]:   </devices>
Jul 26 17:09:42 user nova-compute[70594]: </domain>
Jul 26 17:09:42 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-971400957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-971400957',id=24,image_ref='3ba5d89a-2b38-4460-9936-80f7c426522b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1944995380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-1rhi3h8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member',shelved_at='2023-07-26T17:07:45.419604',shelved_host='user',shelved_image_id='3ba5d89a-2b38-4460-9936-80f7c426522b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:09:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=572dfc14-2bf8-4947-9396-63cd364ccf39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG os_vif [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa89a2f0d-bf, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa89a2f0d-bf, col_values=(('external_ids', {'iface-id': 'a89a2f0d-bff5-44b5-a17a-d5037afa4f05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:72:22', 'vm-uuid': '572dfc14-2bf8-4947-9396-63cd364ccf39'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:42 user nova-compute[70594]: INFO os_vif [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf')
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:09:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] No VIF found with MAC fa:16:3e:19:72:22, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-30b4a9a9-875f-4988-92e6-e839b037052b req-7e00dc45-b459-4591-9dbe-f90f5e83ff6a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-30b4a9a9-875f-4988-92e6-e839b037052b req-7e00dc45-b459-4591-9dbe-f90f5e83ff6a service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-30b4a9a9-875f-4988-92e6-e839b037052b req-7e00dc45-b459-4591-9dbe-f90f5e83ff6a service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-30b4a9a9-875f-4988-92e6-e839b037052b req-7e00dc45-b459-4591-9dbe-f90f5e83ff6a service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-30b4a9a9-875f-4988-92e6-e839b037052b req-7e00dc45-b459-4591-9dbe-f90f5e83ff6a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:09:44 user nova-compute[70594]: WARNING nova.compute.manager [req-30b4a9a9-875f-4988-92e6-e839b037052b req-7e00dc45-b459-4591-9dbe-f90f5e83ff6a service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 26 17:09:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391386.7042074, 572dfc14-2bf8-4947-9396-63cd364ccf39 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:09:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] VM Resumed (Lifecycle Event)
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:09:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance spawned successfully.
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:09:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391386.7097435, 572dfc14-2bf8-4947-9396-63cd364ccf39 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:09:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] VM Started (Lifecycle Event)
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:09:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:09:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-b7965468-6af2-47eb-bc62-b6eeb430ea13 req-057f8a2b-a9d0-497b-bf89-d0ac554bf474 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b7965468-6af2-47eb-bc62-b6eeb430ea13 req-057f8a2b-a9d0-497b-bf89-d0ac554bf474 service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:09:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b7965468-6af2-47eb-bc62-b6eeb430ea13 req-057f8a2b-a9d0-497b-bf89-d0ac554bf474 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:09:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b7965468-6af2-47eb-bc62-b6eeb430ea13 req-057f8a2b-a9d0-497b-bf89-d0ac554bf474 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-b7965468-6af2-47eb-bc62-b6eeb430ea13 req-057f8a2b-a9d0-497b-bf89-d0ac554bf474 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:09:47 user nova-compute[70594]: WARNING nova.compute.manager [req-b7965468-6af2-47eb-bc62-b6eeb430ea13 req-057f8a2b-a9d0-497b-bf89-d0ac554bf474 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 26 17:09:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-570ab992-29e3-4ec5-9a64-3919646e96cf tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.405s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:09:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:50 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391375.5868316, 60c4b302-f745-4b4c-8462-258338fcb0fe => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:09:50 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] VM Stopped (Lifecycle Event)
Jul 26 17:09:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-dd905977-f6b5-45ee-b773-35e48012fc88 None None] [instance: 60c4b302-f745-4b4c-8462-258338fcb0fe] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:09:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:09:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-changed-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:09:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Refreshing instance network info cache due to event network-changed-2af76f49-4e55-49ae-a1c4-b4d30309ff95. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:09:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] Acquiring lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:09:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] Acquired lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:09:59 user nova-compute[70594]: DEBUG nova.network.neutron [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Refreshing network info cache for port 2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:10:00 user nova-compute[70594]: DEBUG nova.network.neutron [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updated VIF entry in instance network info cache for port 2af76f49-4e55-49ae-a1c4-b4d30309ff95. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:10:00 user nova-compute[70594]: DEBUG nova.network.neutron [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updating instance_info_cache with network_info: [{"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0071bf21-720e-453f-a8b5-987511f6e3e5 req-db5508a1-f105-4fb9-a7dc-425db4da82f8 service nova] Releasing lock "refresh_cache-f6206aea-d091-4f94-97cc-bb940e53a699" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:01 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:10:01 user nova-compute[70594]: INFO nova.compute.claims [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Claim successful on node user
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:10:02 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.policy [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6af9ec8d9d644c89ba32c10861afba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd253357a8f7b42119a7b91385afa0e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:10:02 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Creating image(s)
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "/opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk 1073741824" returned: 0 in 0.047s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.network.neutron [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Successfully created port: b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Cannot resize image /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.objects.instance [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'migration_context' on Instance uuid 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Ensure instance console log exists: /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.network.neutron [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Successfully updated port: b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.network.neutron [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-changed-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Refreshing instance network info cache due to event network-changed-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:10:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] Acquiring lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.neutron [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.neutron [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Updating instance_info_cache with network_info: [{"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Instance network_info: |[{"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] Acquired lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.neutron [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Refreshing network info cache for port b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Start _get_guest_xml network_info=[{"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:10:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:04 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908853552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908853552',id=32,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-gjsogfon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:02Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=53ab95cc-52ba-45b2-951c-a33ce8bc0dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.objects.instance [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:10:04 user nova-compute[70594]:   <uuid>53ab95cc-52ba-45b2-951c-a33ce8bc0dcc</uuid>
Jul 26 17:10:04 user nova-compute[70594]:   <name>instance-00000020</name>
Jul 26 17:10:04 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:10:04 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:10:04 user nova-compute[70594]:   <metadata>
Jul 26 17:10:04 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:10:04 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:10:04 user nova-compute[70594]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1908853552</nova:name>
Jul 26 17:10:04 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:10:04</nova:creationTime>
Jul 26 17:10:04 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:10:04 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:10:04 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:10:04 user nova-compute[70594]:       <nova:owner>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:user uuid="f6af9ec8d9d644c89ba32c10861afba2">tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member</nova:user>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:project uuid="d253357a8f7b42119a7b91385afa0e8b">tempest-ServerBootFromVolumeStableRescueTest-43751456</nova:project>
Jul 26 17:10:04 user nova-compute[70594]:       </nova:owner>
Jul 26 17:10:04 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:10:04 user nova-compute[70594]:       <nova:ports>
Jul 26 17:10:04 user nova-compute[70594]:         <nova:port uuid="b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0">
Jul 26 17:10:04 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 26 17:10:04 user nova-compute[70594]:         </nova:port>
Jul 26 17:10:04 user nova-compute[70594]:       </nova:ports>
Jul 26 17:10:04 user nova-compute[70594]:     </nova:instance>
Jul 26 17:10:04 user nova-compute[70594]:   </metadata>
Jul 26 17:10:04 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:10:04 user nova-compute[70594]:     <system>
Jul 26 17:10:04 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:10:04 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:10:04 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:10:04 user nova-compute[70594]:       <entry name="serial">53ab95cc-52ba-45b2-951c-a33ce8bc0dcc</entry>
Jul 26 17:10:04 user nova-compute[70594]:       <entry name="uuid">53ab95cc-52ba-45b2-951c-a33ce8bc0dcc</entry>
Jul 26 17:10:04 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:10:04 user nova-compute[70594]:     </system>
Jul 26 17:10:04 user nova-compute[70594]:   </sysinfo>
Jul 26 17:10:04 user nova-compute[70594]:   <os>
Jul 26 17:10:04 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:10:04 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:10:04 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:10:04 user nova-compute[70594]:   </os>
Jul 26 17:10:04 user nova-compute[70594]:   <features>
Jul 26 17:10:04 user nova-compute[70594]:     <acpi/>
Jul 26 17:10:04 user nova-compute[70594]:     <apic/>
Jul 26 17:10:04 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:10:04 user nova-compute[70594]:   </features>
Jul 26 17:10:04 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:10:04 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:10:04 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:10:04 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:10:04 user nova-compute[70594]:   </clock>
Jul 26 17:10:04 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:10:04 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:10:04 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:10:04 user nova-compute[70594]:   </cpu>
Jul 26 17:10:04 user nova-compute[70594]:   <devices>
Jul 26 17:10:04 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:10:04 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:10:04 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk"/>
Jul 26 17:10:04 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:10:04 user nova-compute[70594]:     </disk>
Jul 26 17:10:04 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:10:04 user nova-compute[70594]:       <mac address="fa:16:3e:87:07:f4"/>
Jul 26 17:10:04 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:10:04 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:10:04 user nova-compute[70594]:       <target dev="tapb9c5d4d4-55"/>
Jul 26 17:10:04 user nova-compute[70594]:     </interface>
Jul 26 17:10:04 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:10:04 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/console.log" append="off"/>
Jul 26 17:10:04 user nova-compute[70594]:     </serial>
Jul 26 17:10:04 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:10:04 user nova-compute[70594]:     <video>
Jul 26 17:10:04 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:10:04 user nova-compute[70594]:     </video>
Jul 26 17:10:04 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:10:04 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:10:04 user nova-compute[70594]:     </rng>
Jul 26 17:10:04 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:10:04 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:10:04 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:10:04 user nova-compute[70594]:     </memballoon>
Jul 26 17:10:04 user nova-compute[70594]:   </devices>
Jul 26 17:10:04 user nova-compute[70594]: </domain>
Jul 26 17:10:04 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908853552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908853552',id=32,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-gjsogfon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:02Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=53ab95cc-52ba-45b2-951c-a33ce8bc0dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_vif [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9c5d4d4-55, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9c5d4d4-55, col_values=(('external_ids', {'iface-id': 'b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:07:f4', 'vm-uuid': '53ab95cc-52ba-45b2-951c-a33ce8bc0dcc'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:04 user nova-compute[70594]: INFO os_vif [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55')
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No VIF found with MAC fa:16:3e:87:07:f4, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.neutron [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Updated VIF entry in instance network info cache for port b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.network.neutron [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Updating instance_info_cache with network_info: [{"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0a79ef69-cd63-439e-9fe6-6f93f521232c req-4ff70d51-d1ab-4011-9b06-0643417b41d5 service nova] Releasing lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:04 user nova-compute[70594]: INFO nova.compute.manager [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Attaching volume b7579ffb-498a-41ad-944a-b1f1e5fa42f2 to /dev/vdb
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9128de4-0ca4-43d6-84da-bba167bde8b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d338263-f911-4675-b70e-bda8d0ac81bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250f8e3-451b-42a7-a76b-aff6f09176c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[573be3cd-b67e-40bc-a7c0-3f5ee04909ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:04 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:10:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1d19b-2305-4516-a547-d95281ae92c4]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:04 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updating existing volume attachment record: 5a6430f3-a76a-4add-9844-e69d4932ec9f {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-c2edc632-9118-4633-847f-02a318c2e62e req-b169347c-2521-430b-9e1e-c0bfc793980f service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c2edc632-9118-4633-847f-02a318c2e62e req-b169347c-2521-430b-9e1e-c0bfc793980f service nova] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c2edc632-9118-4633-847f-02a318c2e62e req-b169347c-2521-430b-9e1e-c0bfc793980f service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c2edc632-9118-4633-847f-02a318c2e62e req-b169347c-2521-430b-9e1e-c0bfc793980f service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-c2edc632-9118-4633-847f-02a318c2e62e req-b169347c-2521-430b-9e1e-c0bfc793980f service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] No waiting events found dispatching network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:05 user nova-compute[70594]: WARNING nova.compute.manager [req-c2edc632-9118-4633-847f-02a318c2e62e req-b169347c-2521-430b-9e1e-c0bfc793980f service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received unexpected event network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 for instance with vm_state building and task_state spawning.
Jul 26 17:10:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:06 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391407.8844483, 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:07 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] VM Resumed (Lifecycle Event)
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:10:07 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Instance spawned successfully.
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-aa6b5078-c3c5-4de6-9d66-2c3b3a4d4446 req-c12f7bf9-ae06-41f1-8584-6b5ddf3b6f5a service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-aa6b5078-c3c5-4de6-9d66-2c3b3a4d4446 req-c12f7bf9-ae06-41f1-8584-6b5ddf3b6f5a service nova] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-aa6b5078-c3c5-4de6-9d66-2c3b3a4d4446 req-c12f7bf9-ae06-41f1-8584-6b5ddf3b6f5a service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-aa6b5078-c3c5-4de6-9d66-2c3b3a4d4446 req-c12f7bf9-ae06-41f1-8584-6b5ddf3b6f5a service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-aa6b5078-c3c5-4de6-9d66-2c3b3a4d4446 req-c12f7bf9-ae06-41f1-8584-6b5ddf3b6f5a service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] No waiting events found dispatching network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:08 user nova-compute[70594]: WARNING nova.compute.manager [req-aa6b5078-c3c5-4de6-9d66-2c3b3a4d4446 req-c12f7bf9-ae06-41f1-8584-6b5ddf3b6f5a service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received unexpected event network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 for instance with vm_state building and task_state spawning.
Jul 26 17:10:08 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:10:08 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391407.8855112, 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:08 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] VM Started (Lifecycle Event)
Jul 26 17:10:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:08 user nova-compute[70594]: INFO nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Took 5.50 seconds to spawn the instance on the hypervisor.
Jul 26 17:10:08 user nova-compute[70594]: DEBUG nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:08 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:08 user nova-compute[70594]: INFO nova.compute.manager [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Took 6.29 seconds to build instance.
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-51a70243-996e-453f-b372-ff4a4ba08d26 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.392s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:11 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:11 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7192MB free_disk=25.183704376220703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f6206aea-d091-4f94-97cc-bb940e53a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 636d93f0-fdb5-46bc-8835-d35298ad7afb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 572dfc14-2bf8-4947-9396-63cd364ccf39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:10:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYcoqAsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:14 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:14 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:14 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ad3a2-01b4-4011-8037-19d537caa564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:10:14 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a786a4dd-e976-46a5-aaf1-6a267f475069]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2] added
Jul 26 17:10:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5ceec1-04dc-4fe5-a8db-d3c9d340f5b4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d774c239-ce6c-4630-be92-a29b52671ac5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYcoqAsL {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYcoqAsL" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0386a38-e829-4217-9aaf-97857ed51a82]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYcoqAsL'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ac6b1-7ffc-47a6-9723-cbfa8984d68d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[614cfc2b-0a07-41d6-b4c7-8a087ec72251]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4111bf5-ea15-4da4-bcf2-bc621630692b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260]
Jul 26 17:10:14 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2be2e-b239-4b70-97e4-b2b7fc718645]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03498ddd-59e2-4b0c-88ae-f57acc7bf749]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3acdc-4523-4433-b89a-3ae00ab6e3d3]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYcoqAsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'flavor' on Instance uuid 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:15 user nova-compute[70594]: INFO nova.compute.manager [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Attaching volume a108e176-edbe-4cc4-a34a-b3631dddaf3a to /dev/vdb
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.utils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a434dc7-b6da-40d8-8e33-efef3ba5901e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d098fb-0b9a-4e99-b660-cebed92d2c0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5883aea-fe3b-4646-92e5-d42a7c39c0f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da209c09-3eca-4e20-8388-f115730db930]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:15 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:10:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3399f22b-f1b5-4c9b-bcf1-dd2311b196a9]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.utils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating existing volume attachment record: adf9fdc1-d770-41be-ba4b-04610add4119 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26233366334386337', 'path': '/dev/sdf'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233366334386337', 'path': '/dev/sdf'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:10:15 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:10:15 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:10:15 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:10:15 user nova-compute[70594]:   <serial>b7579ffb-498a-41ad-944a-b1f1e5fa42f2</serial>
Jul 26 17:10:15 user nova-compute[70594]: </disk>
Jul 26 17:10:15 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:a5:23:44, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:10:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fcffe3a0-631d-440a-9506-4a43712439eb tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.300s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "8017929d-0393-43f1-8c12-34dc27c133dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:10:19 user nova-compute[70594]: INFO nova.compute.claims [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Claim successful on node user
Jul 26 17:10:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:10:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:10:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.policy [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7389a1c933cc4c24b20281842b82e83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b689bf7a7c5049dbac0edae98843930c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:10:20 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Creating image(s)
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "/opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.176s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk 1073741824" returned: 0 in 0.051s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Successfully created port: 883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Cannot resize image /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'migration_context' on Instance uuid 8017929d-0393-43f1-8c12-34dc27c133dc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Ensure instance console log exists: /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Successfully updated port: 883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquired lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-changed-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Refreshing instance network info cache due to event network-changed-883942cd-6dde-42ad-8f2e-41f21f1a3361. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] Acquiring lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:10:21 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Updating instance_info_cache with network_info: [{"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Releasing lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Instance network_info: |[{"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] Acquired lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Refreshing network info cache for port 883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Start _get_guest_xml network_info=[{"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:10:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:10:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1210694201',display_name='tempest-AttachVolumeNegativeTest-server-1210694201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1210694201',id=33,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBttumho6iYp+E44MFbd0TFnN2dCtFt8bF9GG6eviI1Y9zsSsrECjatyuaRWs06qqOFaTkfyckkdsAEKvF/7uG1pWrhwueoXgtfS4PAX6cKqYlH0UgYt8Y4Xy3lbTAlcuA==',key_name='tempest-keypair-929950196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-0o04kc5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=8017929d-0393-43f1-8c12-34dc27c133dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'pci_devices' on Instance uuid 8017929d-0393-43f1-8c12-34dc27c133dc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:10:22 user nova-compute[70594]:   <uuid>8017929d-0393-43f1-8c12-34dc27c133dc</uuid>
Jul 26 17:10:22 user nova-compute[70594]:   <name>instance-00000021</name>
Jul 26 17:10:22 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:10:22 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:10:22 user nova-compute[70594]:   <metadata>
Jul 26 17:10:22 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:10:22 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:10:22 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1210694201</nova:name>
Jul 26 17:10:22 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:10:22</nova:creationTime>
Jul 26 17:10:22 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:10:22 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:10:22 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:10:22 user nova-compute[70594]:       <nova:owner>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:user uuid="7389a1c933cc4c24b20281842b82e83b">tempest-AttachVolumeNegativeTest-1151062115-project-member</nova:user>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:project uuid="b689bf7a7c5049dbac0edae98843930c">tempest-AttachVolumeNegativeTest-1151062115</nova:project>
Jul 26 17:10:22 user nova-compute[70594]:       </nova:owner>
Jul 26 17:10:22 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:10:22 user nova-compute[70594]:       <nova:ports>
Jul 26 17:10:22 user nova-compute[70594]:         <nova:port uuid="883942cd-6dde-42ad-8f2e-41f21f1a3361">
Jul 26 17:10:22 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:10:22 user nova-compute[70594]:         </nova:port>
Jul 26 17:10:22 user nova-compute[70594]:       </nova:ports>
Jul 26 17:10:22 user nova-compute[70594]:     </nova:instance>
Jul 26 17:10:22 user nova-compute[70594]:   </metadata>
Jul 26 17:10:22 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:10:22 user nova-compute[70594]:     <system>
Jul 26 17:10:22 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:10:22 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:10:22 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:10:22 user nova-compute[70594]:       <entry name="serial">8017929d-0393-43f1-8c12-34dc27c133dc</entry>
Jul 26 17:10:22 user nova-compute[70594]:       <entry name="uuid">8017929d-0393-43f1-8c12-34dc27c133dc</entry>
Jul 26 17:10:22 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:10:22 user nova-compute[70594]:     </system>
Jul 26 17:10:22 user nova-compute[70594]:   </sysinfo>
Jul 26 17:10:22 user nova-compute[70594]:   <os>
Jul 26 17:10:22 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:10:22 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:10:22 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:10:22 user nova-compute[70594]:   </os>
Jul 26 17:10:22 user nova-compute[70594]:   <features>
Jul 26 17:10:22 user nova-compute[70594]:     <acpi/>
Jul 26 17:10:22 user nova-compute[70594]:     <apic/>
Jul 26 17:10:22 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:10:22 user nova-compute[70594]:   </features>
Jul 26 17:10:22 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:10:22 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:10:22 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:10:22 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:10:22 user nova-compute[70594]:   </clock>
Jul 26 17:10:22 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:10:22 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:10:22 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:10:22 user nova-compute[70594]:   </cpu>
Jul 26 17:10:22 user nova-compute[70594]:   <devices>
Jul 26 17:10:22 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:10:22 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:10:22 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk"/>
Jul 26 17:10:22 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:10:22 user nova-compute[70594]:     </disk>
Jul 26 17:10:22 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:10:22 user nova-compute[70594]:       <mac address="fa:16:3e:de:b2:5d"/>
Jul 26 17:10:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:10:22 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:10:22 user nova-compute[70594]:       <target dev="tap883942cd-6d"/>
Jul 26 17:10:22 user nova-compute[70594]:     </interface>
Jul 26 17:10:22 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:10:22 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/console.log" append="off"/>
Jul 26 17:10:22 user nova-compute[70594]:     </serial>
Jul 26 17:10:22 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:10:22 user nova-compute[70594]:     <video>
Jul 26 17:10:22 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:10:22 user nova-compute[70594]:     </video>
Jul 26 17:10:22 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:10:22 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:10:22 user nova-compute[70594]:     </rng>
Jul 26 17:10:22 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:10:22 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:10:22 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:10:22 user nova-compute[70594]:     </memballoon>
Jul 26 17:10:22 user nova-compute[70594]:   </devices>
Jul 26 17:10:22 user nova-compute[70594]: </domain>
Jul 26 17:10:22 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:10:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1210694201',display_name='tempest-AttachVolumeNegativeTest-server-1210694201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1210694201',id=33,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBttumho6iYp+E44MFbd0TFnN2dCtFt8bF9GG6eviI1Y9zsSsrECjatyuaRWs06qqOFaTkfyckkdsAEKvF/7uG1pWrhwueoXgtfS4PAX6cKqYlH0UgYt8Y4Xy3lbTAlcuA==',key_name='tempest-keypair-929950196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-0o04kc5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=8017929d-0393-43f1-8c12-34dc27c133dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_vif [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap883942cd-6d, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap883942cd-6d, col_values=(('external_ids', {'iface-id': '883942cd-6dde-42ad-8f2e-41f21f1a3361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:b2:5d', 'vm-uuid': '8017929d-0393-43f1-8c12-34dc27c133dc'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:22 user nova-compute[70594]: INFO os_vif [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d')
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:de:b2:5d, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEHRKdav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:22 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:22 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:22 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8ae60-f73d-4858-9851-e401a315bbe5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:10:22 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e174bc-9e16-4426-a0c3-227f3a2cb02a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a] added
Jul 26 17:10:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c0309c-6df6-45cc-91be-5a0c9c309082]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae373e6-b18f-4640-b4c9-1566096dbf9d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEHRKdav {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEHRKdav" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[90244a1e-67f8-4f91-966f-b378d9deea8f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qEHRKdav'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c418a5-0a0d-415d-b78f-b46318ec6248]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[95832ce5-8f90-4170-a761-db4ce6ba74db]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Updated VIF entry in instance network info cache for port 883942cd-6dde-42ad-8f2e-41f21f1a3361. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Updating instance_info_cache with network_info: [{"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9c128dbf-c374-4f56-8c05-21732ab63843 req-680b3831-25d9-48dd-b919-f405d3f3784f service nova] Releasing lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae71240f-4de1-4ac8-bade-debc0e433fcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260]
Jul 26 17:10:22 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29252b-ab1a-4222-938f-939245537d10]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[57404423-7cb3-4d5b-a333-6d61d6133649]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:22 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:22 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[24163047-f88d-45db-9019-762aff1648ef]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:10:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEHRKdav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26131613062336637', 'path': '/dev/sdg'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131613062336637', 'path': '/dev/sdg'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'flavor' on Instance uuid 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:10:23 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:10:23 user nova-compute[70594]:   <source dev="/dev/sdg"/>
Jul 26 17:10:23 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:10:23 user nova-compute[70594]:   <serial>a108e176-edbe-4cc4-a34a-b3631dddaf3a</serial>
Jul 26 17:10:23 user nova-compute[70594]: </disk>
Jul 26 17:10:23 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f25372c-38b3-4761-8935-d71af7d96765 req-2a818e38-2376-41c9-9e12-6f98cfb70c55 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f25372c-38b3-4761-8935-d71af7d96765 req-2a818e38-2376-41c9-9e12-6f98cfb70c55 service nova] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f25372c-38b3-4761-8935-d71af7d96765 req-2a818e38-2376-41c9-9e12-6f98cfb70c55 service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f25372c-38b3-4761-8935-d71af7d96765 req-2a818e38-2376-41c9-9e12-6f98cfb70c55 service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f25372c-38b3-4761-8935-d71af7d96765 req-2a818e38-2376-41c9-9e12-6f98cfb70c55 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] No waiting events found dispatching network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:23 user nova-compute[70594]: WARNING nova.compute.manager [req-9f25372c-38b3-4761-8935-d71af7d96765 req-2a818e38-2376-41c9-9e12-6f98cfb70c55 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received unexpected event network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 for instance with vm_state building and task_state spawning.
Jul 26 17:10:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] No VIF found with MAC fa:16:3e:5c:0b:4c, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:10:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e90c08a2-de7f-4671-a53c-aa935d2a70f1 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.350s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b644e104-01dc-40b4-bbf3-2b5092234fe6 req-102d0955-fbef-41f3-827c-15e9e60c7bfc service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b644e104-01dc-40b4-bbf3-2b5092234fe6 req-102d0955-fbef-41f3-827c-15e9e60c7bfc service nova] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b644e104-01dc-40b4-bbf3-2b5092234fe6 req-102d0955-fbef-41f3-827c-15e9e60c7bfc service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b644e104-01dc-40b4-bbf3-2b5092234fe6 req-102d0955-fbef-41f3-827c-15e9e60c7bfc service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-b644e104-01dc-40b4-bbf3-2b5092234fe6 req-102d0955-fbef-41f3-827c-15e9e60c7bfc service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] No waiting events found dispatching network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:25 user nova-compute[70594]: WARNING nova.compute.manager [req-b644e104-01dc-40b4-bbf3-2b5092234fe6 req-102d0955-fbef-41f3-827c-15e9e60c7bfc service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received unexpected event network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 for instance with vm_state building and task_state spawning.
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391426.0339186, 8017929d-0393-43f1-8c12-34dc27c133dc => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] VM Resumed (Lifecycle Event)
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Instance spawned successfully.
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391426.0342784, 8017929d-0393-43f1-8c12-34dc27c133dc => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] VM Started (Lifecycle Event)
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Took 5.96 seconds to spawn the instance on the hypervisor.
Jul 26 17:10:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:26 user nova-compute[70594]: INFO nova.compute.manager [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Took 6.96 seconds to build instance.
Jul 26 17:10:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f501b49-3676-45d7-b311-65d242601d36 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "8017929d-0393-43f1-8c12-34dc27c133dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.069s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing instance network info cache due to event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updated VIF entry in instance network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG nova.network.neutron [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cca7f631-d9b6-44c3-a8d2-05fbf71cd37a req-3b0e4427-6c93-4d33-a75c-8fc75461e8ed service nova] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing instance network info cache due to event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG nova.network.neutron [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:29 user nova-compute[70594]: INFO nova.compute.manager [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Rebooting instance
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG nova.network.neutron [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updated VIF entry in instance network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG nova.network.neutron [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9e6ccb63-dc25-4734-a8f5-981c7f98ebb4 req-f86af97c-1f26-4e34-920a-a99f278d1bc8 service nova] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:10:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:30 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-333e9ad4-b998-4cc8-85d7-b173dea42820 req-9991f13a-0bc7-4e0c-8a77-16a32fcfc113 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-unplugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-333e9ad4-b998-4cc8-85d7-b173dea42820 req-9991f13a-0bc7-4e0c-8a77-16a32fcfc113 service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-333e9ad4-b998-4cc8-85d7-b173dea42820 req-9991f13a-0bc7-4e0c-8a77-16a32fcfc113 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-333e9ad4-b998-4cc8-85d7-b173dea42820 req-9991f13a-0bc7-4e0c-8a77-16a32fcfc113 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-333e9ad4-b998-4cc8-85d7-b173dea42820 req-9991f13a-0bc7-4e0c-8a77-16a32fcfc113 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-unplugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:33 user nova-compute[70594]: WARNING nova.compute.manager [req-333e9ad4-b998-4cc8-85d7-b173dea42820 req-9991f13a-0bc7-4e0c-8a77-16a32fcfc113 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-unplugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state active and task_state reboot_started.
Jul 26 17:10:33 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance shutdown successfully.
Jul 26 17:10:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-491a42f7-e68f-4ef5-9986-2d38fcde9474 req-e920c046-06f5-4e35-b241-d295efa1554a service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-491a42f7-e68f-4ef5-9986-2d38fcde9474 req-e920c046-06f5-4e35-b241-d295efa1554a service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-491a42f7-e68f-4ef5-9986-2d38fcde9474 req-e920c046-06f5-4e35-b241-d295efa1554a service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-491a42f7-e68f-4ef5-9986-2d38fcde9474 req-e920c046-06f5-4e35-b241-d295efa1554a service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-491a42f7-e68f-4ef5-9986-2d38fcde9474 req-e920c046-06f5-4e35-b241-d295efa1554a service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:35 user nova-compute[70594]: WARNING nova.compute.manager [req-491a42f7-e68f-4ef5-9986-2d38fcde9474 req-e920c046-06f5-4e35-b241-d295efa1554a service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state active and task_state reboot_started.
Jul 26 17:10:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 7198cc04-ff6c-4a24-8e4f-e5db85060811 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391437.4300048, 7198cc04-ff6c-4a24-8e4f-e5db85060811 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] VM Resumed (Lifecycle Event)
Jul 26 17:10:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance running successfully.
Jul 26 17:10:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance soft rebooted successfully.
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391437.434108, 7198cc04-ff6c-4a24-8e4f-e5db85060811 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] VM Started (Lifecycle Event)
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d25f7b99-bd2d-4d6f-8c2a-0f99c526ca92 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.695s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:37 user nova-compute[70594]: WARNING nova.compute.manager [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state active and task_state None.
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:37 user nova-compute[70594]: WARNING nova.compute.manager [req-d73a99c7-759f-49d4-8cfe-d003f9e448b2 req-00f720d4-e2f3-4272-b1c2-651ee30be0f3 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state active and task_state None.
Jul 26 17:10:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-changed-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Refreshing instance network info cache due to event network-changed-17dbf405-7f7b-4583-8d0a-0b000757a47d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:10:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] Acquiring lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] Acquired lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Refreshing network info cache for port 17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:10:39 user nova-compute[70594]: INFO nova.compute.manager [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Unrescuing
Jul 26 17:10:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:39 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:10:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:10:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquired lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:10:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:10:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'info_cache' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Releasing lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.network.neutron [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updated VIF entry in instance network info cache for port 17dbf405-7f7b-4583-8d0a-0b000757a47d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.network.neutron [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating instance_info_cache with network_info: [{"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9a8cc570-d17d-41f5-b275-cc2ef5ab0975 req-8a9ae03e-5b69-4d15-b78a-c7b724ff2e66 service nova] Releasing lock "refresh_cache-618adbc0-feb7-4fdf-99f2-49ea967ab92d" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance destroyed successfully.
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'resources' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef9e468-62, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.objects.instance [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'flavor' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:41 user nova-compute[70594]: INFO os_vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62')
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:41 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6212cdaa-3625-4342-9abb-c5fb167bb858]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:10:41 user nova-compute[70594]: No targets found.
Jul 26 17:10:41 user nova-compute[70594]: iSNS:
Jul 26 17:10:41 user nova-compute[70594]: No targets found.
Jul 26 17:10:41 user nova-compute[70594]: STATIC:
Jul 26 17:10:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:10:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:10:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:10:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:10:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:10:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:10:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:41 user nova-compute[70594]: FIRMWARE:
Jul 26 17:10:41 user nova-compute[70594]: No targets found.
Jul 26 17:10:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:10:41 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:10:41 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5329a-6949-444c-998b-9b77ca8fb3f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a1397f-5a48-4142-bb4b-36184312a52c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:41 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591036a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b14c5-6004-45f7-95a5-80b10ae51888]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed49313-e2b8-45f3-9525-78db48cbcd14]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41fb515-f52b-48da-9a4e-7bc7ff5b6a1a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.075s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[723156bf-2e63-4bac-bc2b-3d122c35ba1f]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa020f-00b9-478c-99b3-bdc91a100b8b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[81de0d21-cbc0-4ca6-aed9-2074596a23e9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]
Jul 26 17:10:41 user nova-compute[70594]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a04389f-3fab-4bdb-95e3-821c11b536e2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== disconnect_volume: return (420ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-e19849db-6ac9-43cb-8f64-438f370c89af req-c2a00cd5-d027-46c0-b9cd-592461bc7dbe service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e19849db-6ac9-43cb-8f64-438f370c89af req-c2a00cd5-d027-46c0-b9cd-592461bc7dbe service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e19849db-6ac9-43cb-8f64-438f370c89af req-c2a00cd5-d027-46c0-b9cd-592461bc7dbe service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e19849db-6ac9-43cb-8f64-438f370c89af req-c2a00cd5-d027-46c0-b9cd-592461bc7dbe service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-e19849db-6ac9-43cb-8f64-438f370c89af req-c2a00cd5-d027-46c0-b9cd-592461bc7dbe service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:41 user nova-compute[70594]: WARNING nova.compute.manager [req-e19849db-6ac9-43cb-8f64-438f370c89af req-c2a00cd5-d027-46c0-b9cd-592461bc7dbe service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start _get_guest_xml network_info=[{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '35205a75-e9a7-49a5-96f8-57631680ca05', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4233220-d3cd-4278-960b-5592325d5e63', 'serial': 'b4233220-d3cd-4278-960b-5592325d5e63'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'ce4cf7fe-7ca6-4630-86ea-0564245a202b', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'numa_topology' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:42 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:42 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:42 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:42 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:42 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'flavor' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48986f-cc0d-4fa1-b28e-a1ce15566476]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:10:42 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b4b26a-5b55-48be-a9a5-475beee47023]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63] added
Jul 26 17:10:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd9c234-e2e3-4fd4-95ec-b4db667c4beb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e317dc3-0fac-4b2e-8e26-3f5677d444e5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEixzaCS {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEixzaCS" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54cc6b-d460-418a-a93e-2b0d6b47d4d0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEixzaCS'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba639e17-2c54-4054-898d-1b7905e62023]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b842ca-827a-4892-8507-a33cb1991fb0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:42 user nova-compute[70594]: INFO nova.compute.manager [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attaching volume 55a33e78-bc12-4d1c-9496-0730f75db71a to /dev/vdb
Jul 26 17:10:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance destroyed successfully.
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[82234948-e3ed-465a-963b-1c876b502a18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]
Jul 26 17:10:42 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b178e2-82c9-4717-9d1a-52a1d49c3417]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe7fdd7-53eb-494a-9561-d4e957789d1b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:42 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.utils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e5008-2aaf-455e-ad40-be3b089542eb]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d064e46-0277-4789-9d44-f4f29628a188]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3803743-31fb-47f2-95e7-ec79ae13e1db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e74ffc-a7af-4d1c-9dd3-1d6904ed4582]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a075ec-6c57-4d8a-aa76-a7c881ec4f78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:42 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:10:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed3dc5-3da2-4aa8-a66f-5302ab7c5f64]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG os_brick.utils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:42 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating existing volume attachment record: a2670b54-a587-43ac-9aa7-9cb37f015ef0 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23236346361356535', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236346361356535', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'pci_devices' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:10:43 user nova-compute[70594]:   <uuid>35205a75-e9a7-49a5-96f8-57631680ca05</uuid>
Jul 26 17:10:43 user nova-compute[70594]:   <name>instance-00000019</name>
Jul 26 17:10:43 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:10:43 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:10:43 user nova-compute[70594]:   <metadata>
Jul 26 17:10:43 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:10:43 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:10:43 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeTestJSON-server-1367667271</nova:name>
Jul 26 17:10:43 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:10:42</nova:creationTime>
Jul 26 17:10:43 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:10:43 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:10:43 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:10:43 user nova-compute[70594]:       <nova:owner>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:user uuid="5c300fdc9bda48b1afdd00fbc5a6245e">tempest-AttachVolumeTestJSON-35291756-project-member</nova:user>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:project uuid="0459f7d07ec54e3bbfe3915b2b7cfd7b">tempest-AttachVolumeTestJSON-35291756</nova:project>
Jul 26 17:10:43 user nova-compute[70594]:       </nova:owner>
Jul 26 17:10:43 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:10:43 user nova-compute[70594]:       <nova:ports>
Jul 26 17:10:43 user nova-compute[70594]:         <nova:port uuid="5ef9e468-621a-440e-8561-ab66e60d5b8b">
Jul 26 17:10:43 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:10:43 user nova-compute[70594]:         </nova:port>
Jul 26 17:10:43 user nova-compute[70594]:       </nova:ports>
Jul 26 17:10:43 user nova-compute[70594]:     </nova:instance>
Jul 26 17:10:43 user nova-compute[70594]:   </metadata>
Jul 26 17:10:43 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:10:43 user nova-compute[70594]:     <system>
Jul 26 17:10:43 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:10:43 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:10:43 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:10:43 user nova-compute[70594]:       <entry name="serial">35205a75-e9a7-49a5-96f8-57631680ca05</entry>
Jul 26 17:10:43 user nova-compute[70594]:       <entry name="uuid">35205a75-e9a7-49a5-96f8-57631680ca05</entry>
Jul 26 17:10:43 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:10:43 user nova-compute[70594]:     </system>
Jul 26 17:10:43 user nova-compute[70594]:   </sysinfo>
Jul 26 17:10:43 user nova-compute[70594]:   <os>
Jul 26 17:10:43 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:10:43 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:10:43 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:10:43 user nova-compute[70594]:   </os>
Jul 26 17:10:43 user nova-compute[70594]:   <features>
Jul 26 17:10:43 user nova-compute[70594]:     <acpi/>
Jul 26 17:10:43 user nova-compute[70594]:     <apic/>
Jul 26 17:10:43 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:10:43 user nova-compute[70594]:   </features>
Jul 26 17:10:43 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:10:43 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:10:43 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:10:43 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:10:43 user nova-compute[70594]:   </clock>
Jul 26 17:10:43 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:10:43 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:10:43 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:10:43 user nova-compute[70594]:   </cpu>
Jul 26 17:10:43 user nova-compute[70594]:   <devices>
Jul 26 17:10:43 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:10:43 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:10:43 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk"/>
Jul 26 17:10:43 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:10:43 user nova-compute[70594]:     </disk>
Jul 26 17:10:43 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:10:43 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:10:43 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:10:43 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:10:43 user nova-compute[70594]:       <serial>b4233220-d3cd-4278-960b-5592325d5e63</serial>
Jul 26 17:10:43 user nova-compute[70594]:     </disk>
Jul 26 17:10:43 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:10:43 user nova-compute[70594]:       <mac address="fa:16:3e:36:f4:ab"/>
Jul 26 17:10:43 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:10:43 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:10:43 user nova-compute[70594]:       <target dev="tap5ef9e468-62"/>
Jul 26 17:10:43 user nova-compute[70594]:     </interface>
Jul 26 17:10:43 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:10:43 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/console.log" append="off"/>
Jul 26 17:10:43 user nova-compute[70594]:     </serial>
Jul 26 17:10:43 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:10:43 user nova-compute[70594]:     <video>
Jul 26 17:10:43 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:10:43 user nova-compute[70594]:     </video>
Jul 26 17:10:43 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:10:43 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:10:43 user nova-compute[70594]:     </rng>
Jul 26 17:10:43 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:10:43 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:10:43 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:10:43 user nova-compute[70594]:     </memballoon>
Jul 26 17:10:43 user nova-compute[70594]:   </devices>
Jul 26 17:10:43 user nova-compute[70594]: </domain>
Jul 26 17:10:43 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-c58d8f2b-ce96-4203-a502-fcb90f0f0828 req-f3c85e30-ce3c-402d-9ee8-f999eb7bc75d service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c58d8f2b-ce96-4203-a502-fcb90f0f0828 req-f3c85e30-ce3c-402d-9ee8-f999eb7bc75d service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c58d8f2b-ce96-4203-a502-fcb90f0f0828 req-f3c85e30-ce3c-402d-9ee8-f999eb7bc75d service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c58d8f2b-ce96-4203-a502-fcb90f0f0828 req-f3c85e30-ce3c-402d-9ee8-f999eb7bc75d service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-c58d8f2b-ce96-4203-a502-fcb90f0f0828 req-f3c85e30-ce3c-402d-9ee8-f999eb7bc75d service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:44 user nova-compute[70594]: WARNING nova.compute.manager [req-c58d8f2b-ce96-4203-a502-fcb90f0f0828 req-f3c85e30-ce3c-402d-9ee8-f999eb7bc75d service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Cannot resize image /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'migration_context' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG os_vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef9e468-62, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ef9e468-62, col_values=(('external_ids', {'iface-id': '5ef9e468-621a-440e-8561-ab66e60d5b8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f4:ab', 'vm-uuid': '35205a75-e9a7-49a5-96f8-57631680ca05'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:44 user nova-compute[70594]: INFO os_vif [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62')
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:45 user nova-compute[70594]: INFO nova.compute.manager [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attaching volume 23b3c15f-29cb-4c98-8217-c623b7e5f1b4 to /dev/vdb
Jul 26 17:10:45 user nova-compute[70594]: DEBUG os_brick.utils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d809a42-2b7d-4e9c-b91a-17f12d2e2021]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a4b050-2ba6-495c-8098-4294dea798df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42e9880-5845-46bd-9558-456d71ba7a76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e1035-63bd-4d95-9119-3d4f48788814]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:45 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:10:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5de2360-f02c-43bf-9100-a568d11eba9b]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG os_brick.utils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating existing volume attachment record: d84034a2-5d13-4a52-b5b2-fca3a49c65eb {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:46 user nova-compute[70594]: WARNING nova.compute.manager [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:46 user nova-compute[70594]: WARNING nova.compute.manager [req-c8eb5738-0f08-46c3-994f-b5aa8c54f7e3 req-94d2c8f6-c100-4642-bd28-31b6d50c9357 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-332c3be8-46c8-4dcf-95ca-ae1a3f51a93f req-c64a19ca-6b51-4556-9b00-7cf25f2997c3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-332c3be8-46c8-4dcf-95ca-ae1a3f51a93f req-c64a19ca-6b51-4556-9b00-7cf25f2997c3 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-332c3be8-46c8-4dcf-95ca-ae1a3f51a93f req-c64a19ca-6b51-4556-9b00-7cf25f2997c3 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-332c3be8-46c8-4dcf-95ca-ae1a3f51a93f req-c64a19ca-6b51-4556-9b00-7cf25f2997c3 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-332c3be8-46c8-4dcf-95ca-ae1a3f51a93f req-c64a19ca-6b51-4556-9b00-7cf25f2997c3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:46 user nova-compute[70594]: WARNING nova.compute.manager [req-332c3be8-46c8-4dcf-95ca-ae1a3f51a93f req-c64a19ca-6b51-4556-9b00-7cf25f2997c3 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state stopped and task_state powering-on.
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for 9c7ad527-efb9-4cec-8791-010b7a28eab5 due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391446.6478772, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Resumed (Lifecycle Event)
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bc45c08e-dd90-41fe-8253-0e1aebfab63d tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391446.6561663, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:46 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Started (Lifecycle Event)
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391448.352245, 35205a75-e9a7-49a5-96f8-57631680ca05 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:48 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Resumed (Lifecycle Event)
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:10:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance rebooted successfully.
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7f985709-14bf-46be-a215-327c490e6104 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:48 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391448.3554256, 35205a75-e9a7-49a5-96f8-57631680ca05 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:10:48 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Started (Lifecycle Event)
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-1141a786-321d-4458-88cc-f3997c716e81 req-824afa38-ea45-4a0e-a258-00fc1e4540da service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1141a786-321d-4458-88cc-f3997c716e81 req-824afa38-ea45-4a0e-a258-00fc1e4540da service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1141a786-321d-4458-88cc-f3997c716e81 req-824afa38-ea45-4a0e-a258-00fc1e4540da service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1141a786-321d-4458-88cc-f3997c716e81 req-824afa38-ea45-4a0e-a258-00fc1e4540da service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-1141a786-321d-4458-88cc-f3997c716e81 req-824afa38-ea45-4a0e-a258-00fc1e4540da service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:48 user nova-compute[70594]: WARNING nova.compute.manager [req-1141a786-321d-4458-88cc-f3997c716e81 req-824afa38-ea45-4a0e-a258-00fc1e4540da service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state active and task_state None.
Jul 26 17:10:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:50 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[789d1fbb-5ed5-40eb-947f-175283fc9dae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:10:50 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8e529-64ab-482b-b399-3bf59e986bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a] added
Jul 26 17:10:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da11df4-07e6-4486-8133-2d72b4842a1e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f090b4-c1ba-4ad6-85e2-b8c23b9c32b6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnlOEria {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnlOEria" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e7645-c398-47c3-95e1-3ab85768d5a5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnlOEria'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[036e4a87-846f-462f-bbf0-c717a73c8f39]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b55f87-102b-4b3c-b854-6a71374a2758]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec69e0e-7d2a-415a-bec4-17ad0231fe58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]
Jul 26 17:10:51 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[20126908-9cc5-4dc4-8b74-5db905dcc115]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[df103e9e-0fe1-46f3-b556-48c058231267]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:10:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:51 user nova-compute[70594]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:10:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8453d673-4e0e-496d-88c0-62adc42f2f55]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:10:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23538396465353134', 'path': '/dev/sdh'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538396465353134', 'path': '/dev/sdh'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'flavor' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:10:52 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:10:52 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:10:52 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:10:52 user nova-compute[70594]:   <serial>55a33e78-bc12-4d1c-9496-0730f75db71a</serial>
Jul 26 17:10:52 user nova-compute[70594]: </disk>
Jul 26 17:10:52 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No VIF found with MAC fa:16:3e:5e:43:0c, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:10:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3bc786ec-c8b0-4541-9ff5-3f3feebc8299 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.553s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:54 user nova-compute[70594]: INFO nova.compute.manager [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Rebuilding instance
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'pci_requests' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'resources' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'migration_context' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70594) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-dc9ccbe8-7c48-4926-8416-3b38c5795d3c req-657f33dc-afa1-4ab5-8866-aa9856947964 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-unplugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dc9ccbe8-7c48-4926-8416-3b38c5795d3c req-657f33dc-afa1-4ab5-8866-aa9856947964 service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dc9ccbe8-7c48-4926-8416-3b38c5795d3c req-657f33dc-afa1-4ab5-8866-aa9856947964 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dc9ccbe8-7c48-4926-8416-3b38c5795d3c req-657f33dc-afa1-4ab5-8866-aa9856947964 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-dc9ccbe8-7c48-4926-8416-3b38c5795d3c req-657f33dc-afa1-4ab5-8866-aa9856947964 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-unplugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:54 user nova-compute[70594]: WARNING nova.compute.manager [req-dc9ccbe8-7c48-4926-8416-3b38c5795d3c req-657f33dc-afa1-4ab5-8866-aa9856947964 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-unplugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state active and task_state rebuilding.
Jul 26 17:10:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance destroyed successfully.
Jul 26 17:10:55 user nova-compute[70594]: INFO nova.compute.manager [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Detaching volume 55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:10:55 user nova-compute[70594]: INFO nova.virt.block_device [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attempting to driver detach volume 55a33e78-bc12-4d1c-9496-0730f75db71a from mountpoint /dev/vdb
Jul 26 17:10:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Attempting to detach device vdb from instance 6bd16164-caa5-442a-b55c-f84119c36256 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:10:55 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:10:55 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:10:55 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:10:55 user nova-compute[70594]:   <serial>55a33e78-bc12-4d1c-9496-0730f75db71a</serial>
Jul 26 17:10:55 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:10:55 user nova-compute[70594]: </disk>
Jul 26 17:10:55 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:10:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully detached device vdb from instance 6bd16164-caa5-442a-b55c-f84119c36256 from the persistent domain config.
Jul 26 17:10:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:55 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a18dcc-c52f-4505-bb74-649680edbe0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:10:55 user nova-compute[70594]: No targets found.
Jul 26 17:10:55 user nova-compute[70594]: iSNS:
Jul 26 17:10:55 user nova-compute[70594]: No targets found.
Jul 26 17:10:55 user nova-compute[70594]: STATIC:
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:10:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:55 user nova-compute[70594]: FIRMWARE:
Jul 26 17:10:55 user nova-compute[70594]: No targets found.
Jul 26 17:10:55 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:10:55 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:10:55 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e571974-d769-4216-916c-d5187d239f07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68aaef3-2c03-4201-975a-3b171b6e12c4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:10:55 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:55 user nova-compute[70594]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:10:55 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591068edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a'): ({'sdh'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Removing single pathed devices sdh {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb0318a-3216-4f3f-9d77-6dbaca2808ed]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51465f-d605-44cf-860d-31ac5e32b44a]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flushing IO for device /dev/sdh {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f9ab26-996a-4946-9e6d-d7bb6c04147d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0d520-7c1e-4d48-a3f3-38cbf86c48b0]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ad4b4b-6757-4de2-9d99-f93dceb6f5a2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe92ebf-e19d-4970-a844-671ddfe40b2c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]
Jul 26 17:10:55 user nova-compute[70594]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:55 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6370c13-1850-4c75-b0ef-3defa3cf46c4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== disconnect_volume: return (348ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPWhUvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:56 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15da74e-64ab-4700-8a8d-25c407d1f681]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:10:56 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb9c09e-1248-4342-8c27-4d3f0ee355d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4] added
Jul 26 17:10:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2c82ef-3f72-436b-9a7e-3fa814764dd5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b912ce2-d90b-4b01-8fda-6b8bf42eef59]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPWhUvRt {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPWhUvRt" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb742cf-0f77-40f8-a8ac-c796ef7cf00a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPWhUvRt'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[101cf80c-2425-4324-8da2-a1f399f95200]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0db2cf3-a871-4a98-aeb6-ddaac2794470]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de11f4c-ff20-4d34-a45e-bc4b02767d78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260]
Jul 26 17:10:56 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260] successful.
Jul 26 17:10:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6e039f-2407-4325-9672-b2924ef6576e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fafb4f4-a010-45e9-985b-12a521309ece]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:10:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[673cb3a6-80c6-4535-8398-9565f039685e]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPWhUvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-023d29f3-b7a3-4b23-927c-db58fdc3d2a9 req-9539364e-004f-4a79-bccc-220e32a7e789 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-023d29f3-b7a3-4b23-927c-db58fdc3d2a9 req-9539364e-004f-4a79-bccc-220e32a7e789 service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-023d29f3-b7a3-4b23-927c-db58fdc3d2a9 req-9539364e-004f-4a79-bccc-220e32a7e789 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-023d29f3-b7a3-4b23-927c-db58fdc3d2a9 req-9539364e-004f-4a79-bccc-220e32a7e789 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-023d29f3-b7a3-4b23-927c-db58fdc3d2a9 req-9539364e-004f-4a79-bccc-220e32a7e789 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:10:56 user nova-compute[70594]: WARNING nova.compute.manager [req-023d29f3-b7a3-4b23-927c-db58fdc3d2a9 req-9539364e-004f-4a79-bccc-220e32a7e789 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state active and task_state rebuilding.
Jul 26 17:10:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23238353433393234', 'path': '/dev/sdh'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238353433393234', 'path': '/dev/sdh'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:10:57 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:10:57 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:10:57 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:10:57 user nova-compute[70594]:   <serial>23b3c15f-29cb-4c98-8217-c623b7e5f1b4</serial>
Jul 26 17:10:57 user nova-compute[70594]: </disk>
Jul 26 17:10:57 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:10:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance destroyed successfully.
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-183510375',display_name='tempest-ServerActionsTestOtherA-server-1410367531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-183510375',id=27,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-okf8hylx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=6bd16164-caa5-442a-b55c-f84119c36256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG os_vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd093a50-c1, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:10:57 user nova-compute[70594]: INFO os_vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1')
Jul 26 17:10:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:57 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:10:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:10:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No VIF found with MAC fa:16:3e:b1:73:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe46c3-1527-48ca-9211-90ec5e9d80dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:10:58 user nova-compute[70594]: No targets found.
Jul 26 17:10:58 user nova-compute[70594]: iSNS:
Jul 26 17:10:58 user nova-compute[70594]: No targets found.
Jul 26 17:10:58 user nova-compute[70594]: STATIC:
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:10:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:10:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:10:58 user nova-compute[70594]: FIRMWARE:
Jul 26 17:10:58 user nova-compute[70594]: No targets found.
Jul 26 17:10:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:10:58 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:10:58 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5514dd31-56f4-40ff-8e06-0d07017061d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f8363-a9dd-45f5-8f81-279e6ad8100f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:10:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910312170>, {}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Disconnecting from: [] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== disconnect_volume: return (93ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:10:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Deleting instance files /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256_del
Jul 26 17:10:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Deletion of /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256_del complete
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b26bbac4-594f-4377-b37a-3228342bac8b tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.988s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:10:58 user nova-compute[70594]: INFO nova.virt.block_device [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Booting with volume 55a33e78-bc12-4d1c-9496-0730f75db71a at /dev/vdb
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.utils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[872dd9d7-e021-4fac-b58d-5eb96f6fde9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b38b1-da7f-46b8-b0e9-df913acd0929]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc40d273-ceff-4662-9153-535fd68a8908]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c358486a-f936-4ee0-9060-794aeb0563e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:10:58 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:10:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd13359b-5b8c-4ed1-9369-9c83879e746c]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG os_brick.utils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:10:58 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating existing volume attachment record: daf500ff-3c09-447c-92f0-2ffbf78f9a14 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:11:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:05 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:11:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:08 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:09 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391455.1828978, 6bd16164-caa5-442a-b55c-f84119c36256 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:11:10 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] VM Stopped (Lifecycle Event)
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-0f2b9ac2-4bba-402a-b046-8bd27de595f5 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:11:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:11:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=6883MB free_disk=25.140979766845703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:11:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Creating image(s)
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f6206aea-d091-4f94-97cc-bb940e53a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 636d93f0-fdb5-46bc-8835-d35298ad7afb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 572dfc14-2bf8-4947-9396-63cd364ccf39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8017929d-0393-43f1-8c12-34dc27c133dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk 1073741824" returned: 0 in 0.050s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.187s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Cannot resize image /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Ensure instance console log exists: /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Start _get_guest_xml network_info=[{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bd16164-caa5-442a-b55c-f84119c36256', 'attached_at': '', 'detached_at': '', 'volume_id': '55a33e78-bc12-4d1c-9496-0730f75db71a', 'serial': '55a33e78-bc12-4d1c-9496-0730f75db71a'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'daf500ff-3c09-447c-92f0-2ffbf78f9a14', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:11:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 26 17:11:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:11:13 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:11:13 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:11:13 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2172b9ce-4213-43fa-a9c1-5b7cb1e51f09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:11:13 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9deb62-a199-4361-97d4-6ca4dd711613]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a] added
Jul 26 17:11:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83c1ee-7935-43b1-ae6a-7b71a3bd034d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e53d7-5a37-49f4-ab67-c8917818b30a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnlOEria {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnlOEria" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d40d2-6c25-4900-97be-0525e73dbb8a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnlOEria'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96be420-f971-404e-9766-4f6ca0ab5f9f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[00506ecc-1b55-4170-bb08-869ce8b2b607]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e372b21-8274-4797-9b79-13532ffc93b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]
Jul 26 17:11:13 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.
Jul 26 17:11:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19bc14b-3f8c-4976-9a67-4224acb9df72]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c1a8e-fdb7-4189-ad00-0071f7f7ce98]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:11:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:13 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:11:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] HCTL ('40', '-', '-', 0) found on session 36 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c435ff0-e9f9-4d50-a086-c46bb4cf03f6]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching for a device in session 36 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing instance network info cache due to event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:11:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:14 user nova-compute[70594]: INFO nova.compute.manager [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Shelve offloading
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.neutron [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updated VIF entry in instance network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.neutron [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f6991b47-7d8f-4960-9ad6-9ced79127c8a req-ea26985c-88ce-4757-a33e-2cb627b1397e service nova] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23538396465353134', 'path': '/dev/sdi'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538396465353134', 'path': '/dev/sdi'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-183510375',display_name='tempest-ServerActionsTestOtherA-server-1410367531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-183510375',id=27,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-okf8hylx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=6bd16164-caa5-442a-b55c-f84119c36256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:11:14 user nova-compute[70594]:   <uuid>6bd16164-caa5-442a-b55c-f84119c36256</uuid>
Jul 26 17:11:14 user nova-compute[70594]:   <name>instance-0000001b</name>
Jul 26 17:11:14 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:11:14 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:11:14 user nova-compute[70594]:   <metadata>
Jul 26 17:11:14 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:11:14 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:11:14 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherA-server-1410367531</nova:name>
Jul 26 17:11:14 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:11:13</nova:creationTime>
Jul 26 17:11:14 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:11:14 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:11:14 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:11:14 user nova-compute[70594]:       <nova:owner>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:user uuid="feffa97fa65d4c2e963c6ef550377550">tempest-ServerActionsTestOtherA-1622849011-project-member</nova:user>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:project uuid="a4cf13ef41474309a9651baab74f6903">tempest-ServerActionsTestOtherA-1622849011</nova:project>
Jul 26 17:11:14 user nova-compute[70594]:       </nova:owner>
Jul 26 17:11:14 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:11:14 user nova-compute[70594]:       <nova:ports>
Jul 26 17:11:14 user nova-compute[70594]:         <nova:port uuid="fd093a50-c11a-4ba5-b451-63176c04f7a8">
Jul 26 17:11:14 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:11:14 user nova-compute[70594]:         </nova:port>
Jul 26 17:11:14 user nova-compute[70594]:       </nova:ports>
Jul 26 17:11:14 user nova-compute[70594]:     </nova:instance>
Jul 26 17:11:14 user nova-compute[70594]:   </metadata>
Jul 26 17:11:14 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:11:14 user nova-compute[70594]:     <system>
Jul 26 17:11:14 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:11:14 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:11:14 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:11:14 user nova-compute[70594]:       <entry name="serial">6bd16164-caa5-442a-b55c-f84119c36256</entry>
Jul 26 17:11:14 user nova-compute[70594]:       <entry name="uuid">6bd16164-caa5-442a-b55c-f84119c36256</entry>
Jul 26 17:11:14 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:11:14 user nova-compute[70594]:     </system>
Jul 26 17:11:14 user nova-compute[70594]:   </sysinfo>
Jul 26 17:11:14 user nova-compute[70594]:   <os>
Jul 26 17:11:14 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:11:14 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:11:14 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:11:14 user nova-compute[70594]:   </os>
Jul 26 17:11:14 user nova-compute[70594]:   <features>
Jul 26 17:11:14 user nova-compute[70594]:     <acpi/>
Jul 26 17:11:14 user nova-compute[70594]:     <apic/>
Jul 26 17:11:14 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:11:14 user nova-compute[70594]:   </features>
Jul 26 17:11:14 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:11:14 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:11:14 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:11:14 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:11:14 user nova-compute[70594]:   </clock>
Jul 26 17:11:14 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:11:14 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:11:14 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:11:14 user nova-compute[70594]:   </cpu>
Jul 26 17:11:14 user nova-compute[70594]:   <devices>
Jul 26 17:11:14 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:11:14 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:11:14 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk"/>
Jul 26 17:11:14 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:11:14 user nova-compute[70594]:     </disk>
Jul 26 17:11:14 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:11:14 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:11:14 user nova-compute[70594]:       <source dev="/dev/sdi"/>
Jul 26 17:11:14 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:11:14 user nova-compute[70594]:       <serial>55a33e78-bc12-4d1c-9496-0730f75db71a</serial>
Jul 26 17:11:14 user nova-compute[70594]:     </disk>
Jul 26 17:11:14 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:11:14 user nova-compute[70594]:       <mac address="fa:16:3e:5e:43:0c"/>
Jul 26 17:11:14 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:11:14 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:11:14 user nova-compute[70594]:       <target dev="tapfd093a50-c1"/>
Jul 26 17:11:14 user nova-compute[70594]:     </interface>
Jul 26 17:11:14 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:11:14 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/console.log" append="off"/>
Jul 26 17:11:14 user nova-compute[70594]:     </serial>
Jul 26 17:11:14 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:11:14 user nova-compute[70594]:     <video>
Jul 26 17:11:14 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:11:14 user nova-compute[70594]:     </video>
Jul 26 17:11:14 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:11:14 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:11:14 user nova-compute[70594]:     </rng>
Jul 26 17:11:14 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:11:14 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:11:14 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:11:14 user nova-compute[70594]:     </memballoon>
Jul 26 17:11:14 user nova-compute[70594]:   </devices>
Jul 26 17:11:14 user nova-compute[70594]: </domain>
Jul 26 17:11:14 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-183510375',display_name='tempest-ServerActionsTestOtherA-server-1410367531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-183510375',id=27,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-okf8hylx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=6bd16164-caa5-442a-b55c-f84119c36256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG os_vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd093a50-c1, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd093a50-c1, col_values=(('external_ids', {'iface-id': 'fd093a50-c11a-4ba5-b451-63176c04f7a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:43:0c', 'vm-uuid': '6bd16164-caa5-442a-b55c-f84119c36256'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:14 user nova-compute[70594]: INFO os_vif [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1')
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-e7c8b350-aae8-4908-8b15-a78c3627190c req-d4c31bfa-acf7-4df2-94c8-bf907f25fcfe service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e7c8b350-aae8-4908-8b15-a78c3627190c req-d4c31bfa-acf7-4df2-94c8-bf907f25fcfe service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e7c8b350-aae8-4908-8b15-a78c3627190c req-d4c31bfa-acf7-4df2-94c8-bf907f25fcfe service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e7c8b350-aae8-4908-8b15-a78c3627190c req-d4c31bfa-acf7-4df2-94c8-bf907f25fcfe service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-e7c8b350-aae8-4908-8b15-a78c3627190c req-d4c31bfa-acf7-4df2-94c8-bf907f25fcfe service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:14 user nova-compute[70594]: WARNING nova.compute.manager [req-e7c8b350-aae8-4908-8b15-a78c3627190c req-d4c31bfa-acf7-4df2-94c8-bf907f25fcfe service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state shelving.
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:11:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No VIF found with MAC fa:16:3e:5e:43:0c, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [{"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-572dfc14-2bf8-4947-9396-63cd364ccf39" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance destroyed successfully.
Jul 26 17:11:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG nova.network.neutron [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-a5578d32-128e-49ef-96e8-b34d72d70f00 req-1f612ee4-3e7e-44f4-9fe7-1eeffb1e2e7b service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a5578d32-128e-49ef-96e8-b34d72d70f00 req-1f612ee4-3e7e-44f4-9fe7-1eeffb1e2e7b service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a5578d32-128e-49ef-96e8-b34d72d70f00 req-1f612ee4-3e7e-44f4-9fe7-1eeffb1e2e7b service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a5578d32-128e-49ef-96e8-b34d72d70f00 req-1f612ee4-3e7e-44f4-9fe7-1eeffb1e2e7b service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-a5578d32-128e-49ef-96e8-b34d72d70f00 req-1f612ee4-3e7e-44f4-9fe7-1eeffb1e2e7b service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:16 user nova-compute[70594]: WARNING nova.compute.manager [req-a5578d32-128e-49ef-96e8-b34d72d70f00 req-1f612ee4-3e7e-44f4-9fe7-1eeffb1e2e7b service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state active and task_state rebuild_spawning.
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:16 user nova-compute[70594]: WARNING nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state shelving.
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:16 user nova-compute[70594]: WARNING nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state shelving.
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:16 user nova-compute[70594]: WARNING nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state shelving.
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:16 user nova-compute[70594]: WARNING nova.compute.manager [req-c4599460-5c4d-4f7e-911c-0514daf94b47 req-8ee6bc94-37c2-474c-b035-595d6753cd7e service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state shelving.
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance destroyed successfully.
Jul 26 17:11:17 user nova-compute[70594]: DEBUG nova.objects.instance [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'resources' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1924341254',display_name='tempest-TestShelveInstance-server-1924341254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1924341254',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD711OgGvL8zsvkRnXwJ85qTyJEzM/jz9LEhghOi0M8kOEyRHFIeZT7VGCqv0lS8aw7Jha3PuCpybuEhuzP6uNrqPTLg7BfaX9h4TOz2kmXmlcqBdO/hTis4D7HMyCA1pw==',key_name='tempest-TestShelveInstance-284998996',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7f2f383f3f49f89a60c1d12e7e0102',ramdisk_id='',reservation_id='r-0ksxqzxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-448703386',owner_user_name='tempest-TestShelveInstance-448703386-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:09:34Z,user_data=None,user_id='59ec9b7626b3434ca0a3b14075902993',uuid=636d93f0-fdb5-46bc-8835-d35298ad7afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converting VIF {"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_vif [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a2bebe0-90, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:11:17 user nova-compute[70594]: INFO os_vif [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90')
Jul 26 17:11:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:11:17 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8b193-a7b6-4eb1-bdc9-2ed2c1918dca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:11:17 user nova-compute[70594]: No targets found.
Jul 26 17:11:17 user nova-compute[70594]: iSNS:
Jul 26 17:11:17 user nova-compute[70594]: No targets found.
Jul 26 17:11:17 user nova-compute[70594]: STATIC:
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:11:17 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:17 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:17 user nova-compute[70594]: FIRMWARE:
Jul 26 17:11:17 user nova-compute[70594]: No targets found.
Jul 26 17:11:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:11:17 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:11:17 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d900d22-abf8-43a4-a8d4-c36e81e0b049]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69db101-3772-4428-824b-897853b26abc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:11:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:17 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:11:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5900507520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb2566-3c13-4def-89de-d4793f621589]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b3e0a2-d4ef-43db-94bd-676415632266]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf28b97-96f8-4dd9-9a9f-13ea15e25e60]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.111s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df5614-2f08-4263-b810-7d67a8a2535e]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:11:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56397fc2-bdfe-4049-8897-ca8faba28c38]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e6961-4461-43f3-a5b4-a80f3fe1778c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]
Jul 26 17:11:18 user nova-compute[70594]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.
Jul 26 17:11:18 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd1d29-e5c7-431b-8348-5dd4880e5b74]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] <== disconnect_volume: return (486ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:11:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Deleting instance files /opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb_del
Jul 26 17:11:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Deletion of /opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb_del complete
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-7de9d21e-4322-450c-8870-b4a2af6b1252 req-fb5770d6-62b5-493a-afcf-bd63ea9959bd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7de9d21e-4322-450c-8870-b4a2af6b1252 req-fb5770d6-62b5-493a-afcf-bd63ea9959bd service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7de9d21e-4322-450c-8870-b4a2af6b1252 req-fb5770d6-62b5-493a-afcf-bd63ea9959bd service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-7de9d21e-4322-450c-8870-b4a2af6b1252 req-fb5770d6-62b5-493a-afcf-bd63ea9959bd service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-7de9d21e-4322-450c-8870-b4a2af6b1252 req-fb5770d6-62b5-493a-afcf-bd63ea9959bd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:18 user nova-compute[70594]: WARNING nova.compute.manager [req-7de9d21e-4322-450c-8870-b4a2af6b1252 req-fb5770d6-62b5-493a-afcf-bd63ea9959bd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state active and task_state rebuild_spawning.
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:18 user nova-compute[70594]: WARNING nova.compute.manager [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state shelving.
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing instance network info cache due to event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:11:18 user nova-compute[70594]: DEBUG nova.network.neutron [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391479.1170444, 6bd16164-caa5-442a-b55c-f84119c36256 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:11:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] VM Resumed (Lifecycle Event)
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:11:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance spawned successfully.
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:11:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391479.1222425, 6bd16164-caa5-442a-b55c-f84119c36256 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:11:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] VM Started (Lifecycle Event)
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:11:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:19 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Deleted allocations for instance 636d93f0-fdb5-46bc-8835-d35298ad7afb
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70594) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.network.neutron [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updated VIF entry in instance network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.network.neutron [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": null, "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e2a7313f-266e-458d-a7bc-d506c26a3841 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.072s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.objects.instance [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'numa_topology' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b9ccd92-c7af-444b-8417-e08ce124c5f1 req-19321826-0788-41ad-98b3-ca8683c74335 service nova] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:11:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-89a82e5f-0459-4f4f-b51f-6a00efe245cb tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.662s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:24 user nova-compute[70594]: INFO nova.compute.manager [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Terminating instance
Jul 26 17:11:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-c045e497-39a6-4147-bdcc-7bc2ae533903 req-ec4fd756-e307-4c5f-9c7b-6cf389af9b2f service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-unplugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c045e497-39a6-4147-bdcc-7bc2ae533903 req-ec4fd756-e307-4c5f-9c7b-6cf389af9b2f service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c045e497-39a6-4147-bdcc-7bc2ae533903 req-ec4fd756-e307-4c5f-9c7b-6cf389af9b2f service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c045e497-39a6-4147-bdcc-7bc2ae533903 req-ec4fd756-e307-4c5f-9c7b-6cf389af9b2f service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-c045e497-39a6-4147-bdcc-7bc2ae533903 req-ec4fd756-e307-4c5f-9c7b-6cf389af9b2f service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-unplugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-c045e497-39a6-4147-bdcc-7bc2ae533903 req-ec4fd756-e307-4c5f-9c7b-6cf389af9b2f service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-unplugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:11:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Instance destroyed successfully.
Jul 26 17:11:25 user nova-compute[70594]: DEBUG nova.objects.instance [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lazy-loading 'resources' on Instance uuid 572dfc14-2bf8-4947-9396-63cd364ccf39 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-971400957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-971400957',id=24,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAf5rqS8Wqw9PQMSjYkvvxQN63l0mAm/rtFRp46spruamljCb7ZCObtt5TmiXb4sh0Ng2eA9FbtdAaJFc3QYZXih6J5yWU3QqpVH1hVnKPRO2LUdsEm4kCpz/MZ474Iwg==',key_name='tempest-keypair-1944995380',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f389f41a191747e68ceeb776fdcbff40',ramdisk_id='',reservation_id='r-1rhi3h8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1781489687',owner_user_name='tempest-AttachVolumeShelveTestJSON-1781489687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:09:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9714a3b9e9d44f6b22c49d3d495d7ad',uuid=572dfc14-2bf8-4947-9396-63cd364ccf39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converting VIF {"id": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "address": "fa:16:3e:19:72:22", "network": {"id": "e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-266032130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f389f41a191747e68ceeb776fdcbff40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89a2f0d-bf", "ovs_interfaceid": "a89a2f0d-bff5-44b5-a17a-d5037afa4f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG os_vif [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa89a2f0d-bf, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:25 user nova-compute[70594]: INFO os_vif [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:72:22,bridge_name='br-int',has_traffic_filtering=True,id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05,network=Network(e9c6faa0-c5a5-4cdd-a4ad-d05c1b9e1c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89a2f0d-bf')
Jul 26 17:11:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Deleting instance files /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39_del
Jul 26 17:11:25 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Deletion of /opt/stack/data/nova/instances/572dfc14-2bf8-4947-9396-63cd364ccf39_del complete
Jul 26 17:11:25 user nova-compute[70594]: INFO nova.compute.manager [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 26 17:11:25 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:11:25 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:11:26 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Took 0.80 seconds to deallocate network for instance.
Jul 26 17:11:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-7cab158c-30ab-4093-810b-9a74086be27f req-88ff3629-2e6a-405d-b0a9-4414070ca505 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-deleted-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:26 user nova-compute[70594]: INFO nova.compute.manager [req-7cab158c-30ab-4093-810b-9a74086be27f req-88ff3629-2e6a-405d-b0a9-4414070ca505 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Neutron deleted interface a89a2f0d-bff5-44b5-a17a-d5037afa4f05; detaching it from the instance and deleting it from the info cache
Jul 26 17:11:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-7cab158c-30ab-4093-810b-9a74086be27f req-88ff3629-2e6a-405d-b0a9-4414070ca505 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-7cab158c-30ab-4093-810b-9a74086be27f req-88ff3629-2e6a-405d-b0a9-4414070ca505 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Detach interface failed, port_id=a89a2f0d-bff5-44b5-a17a-d5037afa4f05, reason: Instance 572dfc14-2bf8-4947-9396-63cd364ccf39 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:11:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:26 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Deleted allocations for instance 572dfc14-2bf8-4947-9396-63cd364ccf39
Jul 26 17:11:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c52edcb0-3169-47ca-be84-e693b4cebaa6 tempest-AttachVolumeShelveTestJSON-1781489687 tempest-AttachVolumeShelveTestJSON-1781489687-project-member] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-55d1d52f-ef1b-422f-8c9a-0a4e2472cc19 req-2fb2bd16-42a0-4d61-b853-60710d4a2040 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:11:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-55d1d52f-ef1b-422f-8c9a-0a4e2472cc19 req-2fb2bd16-42a0-4d61-b853-60710d4a2040 service nova] Acquiring lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-55d1d52f-ef1b-422f-8c9a-0a4e2472cc19 req-2fb2bd16-42a0-4d61-b853-60710d4a2040 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-55d1d52f-ef1b-422f-8c9a-0a4e2472cc19 req-2fb2bd16-42a0-4d61-b853-60710d4a2040 service nova] Lock "572dfc14-2bf8-4947-9396-63cd364ccf39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-55d1d52f-ef1b-422f-8c9a-0a4e2472cc19 req-2fb2bd16-42a0-4d61-b853-60710d4a2040 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] No waiting events found dispatching network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:11:27 user nova-compute[70594]: WARNING nova.compute.manager [req-55d1d52f-ef1b-422f-8c9a-0a4e2472cc19 req-2fb2bd16-42a0-4d61-b853-60710d4a2040 service nova] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Received unexpected event network-vif-plugged-a89a2f0d-bff5-44b5-a17a-d5037afa4f05 for instance with vm_state deleted and task_state None.
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:11:28 user nova-compute[70594]: INFO nova.compute.manager [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Detaching volume 23b3c15f-29cb-4c98-8217-c623b7e5f1b4
Jul 26 17:11:28 user nova-compute[70594]: INFO nova.virt.block_device [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attempting to driver detach volume 23b3c15f-29cb-4c98-8217-c623b7e5f1b4 from mountpoint /dev/vdb
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Attempting to detach device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:11:28 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:11:28 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:11:28 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:11:28 user nova-compute[70594]:   <serial>23b3c15f-29cb-4c98-8217-c623b7e5f1b4</serial>
Jul 26 17:11:28 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:11:28 user nova-compute[70594]: </disk>
Jul 26 17:11:28 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:11:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config.
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:11:28 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:11:28 user nova-compute[70594]:   <source dev="/dev/sdh"/>
Jul 26 17:11:28 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:11:28 user nova-compute[70594]:   <serial>23b3c15f-29cb-4c98-8217-c623b7e5f1b4</serial>
Jul 26 17:11:28 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:11:28 user nova-compute[70594]: </disk>
Jul 26 17:11:28 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391488.7443435, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:11:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config.
Jul 26 17:11:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPWhUvRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:11:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[27433e78-fdce-4566-8a25-0e2125332e9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:11:28 user nova-compute[70594]: No targets found.
Jul 26 17:11:28 user nova-compute[70594]: iSNS:
Jul 26 17:11:28 user nova-compute[70594]: No targets found.
Jul 26 17:11:28 user nova-compute[70594]: STATIC:
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:11:28 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:11:28 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:11:28 user nova-compute[70594]: FIRMWARE:
Jul 26 17:11:28 user nova-compute[70594]: No targets found.
Jul 26 17:11:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:11:28 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:11:28 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcac72a8-e945-4ef4-9c24-d3564329d429]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1b644a-edcb-4239-a7c6-c89eb7c6bb99]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:11:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 (non-flash)
Jul 26 17:11:28 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:11:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591068cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4'): ({'sdh'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Removing single pathed devices sdh {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0478a179-7d2a-430b-9365-361d1183dfef]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c906ca5-5d7c-419e-ae81-4f6711308b97]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Flushing IO for device /dev/sdh {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56997c44-bad6-493f-ab59-1a522b8c3139]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a87e814-19b4-4643-8b4e-339978fb833b]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] SCSI volumes sdh have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6881708e-4794-4f74-9577-08c0f0018b6c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb0e9b0-0627-4102-af6f-dc83eb169a8e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260]
Jul 26 17:11:29 user nova-compute[70594]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4, portal: 172.16.0.220,3260] successful.
Jul 26 17:11:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b3c15f-29cb-4c98-8217-c623b7e5f1b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8cdad-1266-452e-96e0-74b1876ccabf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== disconnect_volume: return (318ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG nova.objects.instance [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:11:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07dca836-54c8-425f-a84a-d6e00351a29e tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:11:30 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391475.4896622, 636d93f0-fdb5-46bc-8835-d35298ad7afb => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:11:30 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] VM Stopped (Lifecycle Event)
Jul 26 17:11:30 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3fcb78b8-7a9c-45e1-a65e-61ac0b046e8c None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:40 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391485.4932463, 572dfc14-2bf8-4947-9396-63cd364ccf39 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:11:40 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] VM Stopped (Lifecycle Event)
Jul 26 17:11:40 user nova-compute[70594]: DEBUG nova.compute.manager [None req-356409a8-e86a-4eb9-8d68-56b5729c4c63 None None] [instance: 572dfc14-2bf8-4947-9396-63cd364ccf39] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:11:52 user nova-compute[70594]: INFO nova.compute.manager [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] instance snapshotting
Jul 26 17:11:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Beginning live snapshot process
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0ao7x96m/c84ae47d66934701a2846468f78b0091.delta 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0ao7x96m/c84ae47d66934701a2846468f78b0091.delta 1073741824" returned: 0 in 0.060s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 26 17:11:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:11:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:11:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 26 17:11:54 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:11:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0ao7x96m/c84ae47d66934701a2846468f78b0091.delta /opt/stack/data/nova/instances/snapshots/tmp0ao7x96m/c84ae47d66934701a2846468f78b0091 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:11:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0ao7x96m/c84ae47d66934701a2846468f78b0091.delta /opt/stack/data/nova/instances/snapshots/tmp0ao7x96m/c84ae47d66934701a2846468f78b0091" returned: 0 in 0.454s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:11:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Snapshot extracted, beginning image upload
Jul 26 17:11:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:11:57 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Snapshot image upload complete
Jul 26 17:11:57 user nova-compute[70594]: INFO nova.compute.manager [None req-8d480fe9-f05f-4751-b637-74041df5ce1c tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Took 5.02 seconds to snapshot the instance on the hypervisor.
Jul 26 17:12:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:12:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:03 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:12:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:12:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-changed-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG nova.compute.manager [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Refreshing instance network info cache due to event network-changed-883942cd-6dde-42ad-8f2e-41f21f1a3361. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] Acquiring lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] Acquired lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Refreshing network info cache for port 883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "8017929d-0393-43f1-8c12-34dc27c133dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:10 user nova-compute[70594]: INFO nova.compute.manager [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Terminating instance
Jul 26 17:12:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:12:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-a388d959-47ee-4635-8d7a-b4306791d8e7 req-bd7e72b4-32a2-424e-b295-2f266e6bba96 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-vif-unplugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a388d959-47ee-4635-8d7a-b4306791d8e7 req-bd7e72b4-32a2-424e-b295-2f266e6bba96 service nova] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a388d959-47ee-4635-8d7a-b4306791d8e7 req-bd7e72b4-32a2-424e-b295-2f266e6bba96 service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a388d959-47ee-4635-8d7a-b4306791d8e7 req-bd7e72b4-32a2-424e-b295-2f266e6bba96 service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-a388d959-47ee-4635-8d7a-b4306791d8e7 req-bd7e72b4-32a2-424e-b295-2f266e6bba96 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] No waiting events found dispatching network-vif-unplugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-a388d959-47ee-4635-8d7a-b4306791d8e7 req-bd7e72b4-32a2-424e-b295-2f266e6bba96 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-vif-unplugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [{"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-026577e6-2de3-45b9-adbf-7686e72a8c61" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Instance destroyed successfully.
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'resources' on Instance uuid 8017929d-0393-43f1-8c12-34dc27c133dc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:10:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1210694201',display_name='tempest-AttachVolumeNegativeTest-server-1210694201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1210694201',id=33,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBttumho6iYp+E44MFbd0TFnN2dCtFt8bF9GG6eviI1Y9zsSsrECjatyuaRWs06qqOFaTkfyckkdsAEKvF/7uG1pWrhwueoXgtfS4PAX6cKqYlH0UgYt8Y4Xy3lbTAlcuA==',key_name='tempest-keypair-929950196',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-0o04kc5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=8017929d-0393-43f1-8c12-34dc27c133dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG os_vif [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap883942cd-6d, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:12:11 user nova-compute[70594]: INFO os_vif [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:b2:5d,bridge_name='br-int',has_traffic_filtering=True,id=883942cd-6dde-42ad-8f2e-41f21f1a3361,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883942cd-6d')
Jul 26 17:12:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Deleting instance files /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc_del
Jul 26 17:12:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Deletion of /opt/stack/data/nova/instances/8017929d-0393-43f1-8c12-34dc27c133dc_del complete
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Updated VIF entry in instance network info cache for port 883942cd-6dde-42ad-8f2e-41f21f1a3361. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.network.neutron [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Updating instance_info_cache with network_info: [{"id": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "address": "fa:16:3e:de:b2:5d", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883942cd-6d", "ovs_interfaceid": "883942cd-6dde-42ad-8f2e-41f21f1a3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9f1afd52-2d4f-499d-bc26-dd31ffb9bf44 req-27eabf8b-7563-46ca-8435-6b9593ebb46d service nova] Releasing lock "refresh_cache-8017929d-0393-43f1-8c12-34dc27c133dc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:12:11 user nova-compute[70594]: INFO nova.compute.manager [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:12:11 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Error from libvirt while getting description of instance-00000021: [Error Code 42] Domain not found: no domain with matching uuid '8017929d-0393-43f1-8c12-34dc27c133dc' (instance-00000021): libvirt.libvirtError: Domain not found: no domain with matching uuid '8017929d-0393-43f1-8c12-34dc27c133dc' (instance-00000021)
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:12:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:12 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Took 0.92 seconds to deallocate network for instance.
Jul 26 17:12:12 user nova-compute[70594]: DEBUG nova.compute.manager [req-efdd1ed7-f36f-4a90-bd8f-237f50536b08 req-6dcc9e84-3b96-490d-ab25-011ab68d07fd service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-vif-deleted-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:13 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Deleted allocations for instance 8017929d-0393-43f1-8c12-34dc27c133dc
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d89abaf-c1bd-4598-8f6e-152d747de8fd req-5154724b-edd7-4534-b0d3-8230c4c7ab26 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received event network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d89abaf-c1bd-4598-8f6e-152d747de8fd req-5154724b-edd7-4534-b0d3-8230c4c7ab26 service nova] Acquiring lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d89abaf-c1bd-4598-8f6e-152d747de8fd req-5154724b-edd7-4534-b0d3-8230c4c7ab26 service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d89abaf-c1bd-4598-8f6e-152d747de8fd req-5154724b-edd7-4534-b0d3-8230c4c7ab26 service nova] Lock "8017929d-0393-43f1-8c12-34dc27c133dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d89abaf-c1bd-4598-8f6e-152d747de8fd req-5154724b-edd7-4534-b0d3-8230c4c7ab26 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] No waiting events found dispatching network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:12:13 user nova-compute[70594]: WARNING nova.compute.manager [req-3d89abaf-c1bd-4598-8f6e-152d747de8fd req-5154724b-edd7-4534-b0d3-8230c4c7ab26 service nova] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Received unexpected event network-vif-plugged-883942cd-6dde-42ad-8f2e-41f21f1a3361 for instance with vm_state deleted and task_state None.
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ba6cc3fd-510a-44b8-8582-fa0cad2b1f75 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "8017929d-0393-43f1-8c12-34dc27c133dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.403s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:12:15 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:12:15 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7248MB free_disk=25.079978942871094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f6206aea-d091-4f94-97cc-bb940e53a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:12:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:12:16 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:12:16 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:12:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:12:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:12:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing instance network info cache due to event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updated VIF entry in instance network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5cde44f2-7efb-4148-b1ed-8246f9598042 req-c7f0286e-3c35-4402-ade1-06a0107ba45e service nova] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing instance network info cache due to event network-changed-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] Acquiring lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] Acquired lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Refreshing network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:23 user nova-compute[70594]: INFO nova.compute.manager [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Detaching volume a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:12:23 user nova-compute[70594]: INFO nova.virt.block_device [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Attempting to driver detach volume a108e176-edbe-4cc4-a34a-b3631dddaf3a from mountpoint /dev/vdb
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Attempting to detach device vdb from instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:23 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:23 user nova-compute[70594]:   <source dev="/dev/sdg"/>
Jul 26 17:12:23 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:23 user nova-compute[70594]:   <serial>a108e176-edbe-4cc4-a34a-b3631dddaf3a</serial>
Jul 26 17:12:23 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:12:23 user nova-compute[70594]: </disk>
Jul 26 17:12:23 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:23 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully detached device vdb from instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 from the persistent domain config.
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:23 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:23 user nova-compute[70594]:   <source dev="/dev/sdg"/>
Jul 26 17:12:23 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:23 user nova-compute[70594]:   <serial>a108e176-edbe-4cc4-a34a-b3631dddaf3a</serial>
Jul 26 17:12:23 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:12:23 user nova-compute[70594]: </disk>
Jul 26 17:12:23 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updated VIF entry in instance network info cache for port a2dcd74b-a228-4a88-a0bc-ec8bab9d681e. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.network.neutron [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [{"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bdc803af-b93b-412d-9b8d-f9d20e851ec9 req-b960c8d2-5c59-41fe-a611-6d306e9d73da service nova] Releasing lock "refresh_cache-7198cc04-ff6c-4a24-8e4f-e5db85060811" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391543.8247654, 7198cc04-ff6c-4a24-8e4f-e5db85060811 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:12:23 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully detached device vdb from instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 from the live domain config.
Jul 26 17:12:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEHRKdav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:12:23 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e310242c-fe24-43c7-b9d8-15fb85899372]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:12:23 user nova-compute[70594]: No targets found.
Jul 26 17:12:23 user nova-compute[70594]: iSNS:
Jul 26 17:12:23 user nova-compute[70594]: No targets found.
Jul 26 17:12:23 user nova-compute[70594]: STATIC:
Jul 26 17:12:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:12:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:12:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:12:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a
Jul 26 17:12:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:12:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:23 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:12:23 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:23 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:23 user nova-compute[70594]: FIRMWARE:
Jul 26 17:12:23 user nova-compute[70594]: No targets found.
Jul 26 17:12:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:12:23 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:12:23 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[71690481-0085-4a59-8e0b-cd27479dfc8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f67a6d-6179-4d71-baaa-60efdd3d15d3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:23 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:23 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59100f4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a'): ({'sdg'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Removing single pathed devices sdg {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f72e97-ee6b-4729-9054-22666626d974]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[810879d3-cbed-405e-aa82-9d2ac2f8d858]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Flushing IO for device /dev/sdg {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:12:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3380ee5-7d33-4135-9ca3-2002ca690bde]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1396d9-ce8f-43c6-b56e-6dbe8f6e63fd]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] SCSI volumes sdg have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12655dc5-ac67-4d52-aa84-47d5d230b861]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a981982-2a9b-44ad-b795-4983db0d1a55]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260]
Jul 26 17:12:24 user nova-compute[70594]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a, portal: 172.16.0.220,3260] successful.
Jul 26 17:12:24 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a108e176-edbe-4cc4-a34a-b3631dddaf3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[87524a7c-0903-4c0d-a24e-b984d801c6de]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] <== disconnect_volume: return (347ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:24 user nova-compute[70594]: INFO nova.compute.manager [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attaching volume e5e73414-71d9-4e12-aec9-996fb98846e2 to /dev/vdb
Jul 26 17:12:24 user nova-compute[70594]: DEBUG os_brick.utils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:12:24 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecece513-2cfd-4cdb-9092-6ba080024d72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353dae6-d333-40c4-a460-2aff8ed92d5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b467075c-0a96-40a7-802d-ce4348582442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f781a46e-ec10-4b91-a514-ba7e256a94c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:12:25 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9081371-9248-40e0-b0ec-4481e6ebff8e]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG os_brick.utils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating existing volume attachment record: 282e28e0-de50-4db5-a99f-dadc5710dffb {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG nova.objects.instance [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'flavor' on Instance uuid 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da26eecc-ec67-4cc3-901e-15d91eb81ce2 tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:26 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391531.472932, 8017929d-0393-43f1-8c12-34dc27c133dc => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:12:26 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] VM Stopped (Lifecycle Event)
Jul 26 17:12:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c29c70c6-865e-471b-889d-bd0c16510043 None None] [instance: 8017929d-0393-43f1-8c12-34dc27c133dc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:12:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:32 user nova-compute[70594]: INFO nova.compute.manager [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Detaching volume b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDCxeEqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:12:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:12:32 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:12:32 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a603638e-6bd3-471e-9bbb-606647f96af0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:12:32 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bf64e4-6093-46cc-9d89-00efa786eca1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2] added
Jul 26 17:12:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dcb301-5b0a-4786-92f7-2ef1f28f2ea9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02972150-8b4a-4263-ba8c-09b49a4e9786]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: INFO nova.virt.block_device [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Attempting to driver detach volume b4233220-d3cd-4278-960b-5592325d5e63 from mountpoint /dev/vdb
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zDCxeEqb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Attempting to detach device vdb from instance 35205a75-e9a7-49a5-96f8-57631680ca05 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:32 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:32 user nova-compute[70594]:   <source dev="/dev/sdd"/>
Jul 26 17:12:32 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:32 user nova-compute[70594]:   <serial>b4233220-d3cd-4278-960b-5592325d5e63</serial>
Jul 26 17:12:32 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:12:32 user nova-compute[70594]: </disk>
Jul 26 17:12:32 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zDCxeEqb" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96291e29-50a0-4fe5-9d02-cff253d91271]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zDCxeEqb'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully detached device vdb from instance 35205a75-e9a7-49a5-96f8-57631680ca05 from the persistent domain config.
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35205a75-e9a7-49a5-96f8-57631680ca05 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:32 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:32 user nova-compute[70594]:   <source dev="/dev/sdd"/>
Jul 26 17:12:32 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:32 user nova-compute[70594]:   <serial>b4233220-d3cd-4278-960b-5592325d5e63</serial>
Jul 26 17:12:32 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:12:32 user nova-compute[70594]: </disk>
Jul 26 17:12:32 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7444211-e85c-44c0-89c9-b30901265cb5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.compute.manager [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing instance network info cache due to event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG nova.network.neutron [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf35b3b-3c3b-480a-8f6e-40b78d01cd5f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4a7535-4a03-4aea-b857-bd5e78f89a67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260]
Jul 26 17:12:32 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260] successful.
Jul 26 17:12:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[366bc612-8d9f-4c37-9cdb-88bd3a2b8213]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f631822-9dc9-4b67-b5a1-c69cb3dc5ad7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:32 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:32 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b772d44-201f-4549-8385-e6d5a3e66c6e]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:12:32 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDCxeEqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391553.1500263, 35205a75-e9a7-49a5-96f8-57631680ca05 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:12:33 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully detached device vdb from instance 35205a75-e9a7-49a5-96f8-57631680ca05 from the live domain config.
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEixzaCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:12:33 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:33 user nova-compute[70594]: INFO nova.compute.manager [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Detaching volume 14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:12:33 user nova-compute[70594]: INFO nova.virt.block_device [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Attempting to driver detach volume 14216eeb-e0b3-47c2-b5f6-10496a11d60f from mountpoint /dev/vdb
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Attempting to detach device vdb from instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:33 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:33 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:12:33 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:33 user nova-compute[70594]:   <serial>14216eeb-e0b3-47c2-b5f6-10496a11d60f</serial>
Jul 26 17:12:33 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:12:33 user nova-compute[70594]: </disk>
Jul 26 17:12:33 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:33 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully detached device vdb from instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 from the persistent domain config.
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:33 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:33 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:12:33 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:33 user nova-compute[70594]:   <serial>14216eeb-e0b3-47c2-b5f6-10496a11d60f</serial>
Jul 26 17:12:33 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:12:33 user nova-compute[70594]: </disk>
Jul 26 17:12:33 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updated VIF entry in instance network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.network.neutron [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-23596c03-ab41-422a-ae10-9b2e59d71196 req-96925399-8cc6-497e-80c6-f5533dad5f39 service nova] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23935346361396539', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935346361396539', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.786s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG nova.objects.instance [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a7823-0625-4fa8-a59a-43e33f152798]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:12:33 user nova-compute[70594]: No targets found.
Jul 26 17:12:33 user nova-compute[70594]: iSNS:
Jul 26 17:12:33 user nova-compute[70594]: No targets found.
Jul 26 17:12:33 user nova-compute[70594]: STATIC:
Jul 26 17:12:33 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2
Jul 26 17:12:33 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:33 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:33 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:12:33 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:33 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:33 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:12:33 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:33 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:33 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:12:33 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:33 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:33 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:12:33 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:33 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:33 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63
Jul 26 17:12:33 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:33 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:33 user nova-compute[70594]: FIRMWARE:
Jul 26 17:12:33 user nova-compute[70594]: No targets found.
Jul 26 17:12:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:12:33 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:12:33 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:12:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3be6e-e818-4c96-940b-73842ef33d2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:12:34 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:34 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:12:34 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:34 user nova-compute[70594]:   <serial>e5e73414-71d9-4e12-aec9-996fb98846e2</serial>
Jul 26 17:12:34 user nova-compute[70594]: </disk>
Jul 26 17:12:34 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391554.0213516, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:12:34 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully detached device vdb from instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 from the live domain config.
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHRFSGEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:12:34 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2902e460-e695-4a07-8f93-5a59bd2d507b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910369360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7fba2a-edcd-4bb4-aa5a-c9aaff7cf79e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8794811a-3cf4-4894-a228-13c5975a1cd8]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b176f1-8347-42d0-9a80-063162be7291]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b94fb62-1408-4bb0-8286-de243eef32d0]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977f126-5929-4935-8bc2-0c04aa0c79bf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c81b04d-9158-48e7-b462-0e0f87d44390]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260]
Jul 26 17:12:34 user nova-compute[70594]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63, portal: 172.16.0.220,3260] successful.
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4233220-d3cd-4278-960b-5592325d5e63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[10412897-cc7e-4c1f-8190-b3b21cf87a2d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== disconnect_volume: return (1166ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.293s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3aa8ba-db22-4b6b-ac78-fff53ab16f40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:12:34 user nova-compute[70594]: No targets found.
Jul 26 17:12:34 user nova-compute[70594]: iSNS:
Jul 26 17:12:34 user nova-compute[70594]: No targets found.
Jul 26 17:12:34 user nova-compute[70594]: STATIC:
Jul 26 17:12:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2
Jul 26 17:12:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:12:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:12:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:12:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f
Jul 26 17:12:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:34 user nova-compute[70594]: FIRMWARE:
Jul 26 17:12:34 user nova-compute[70594]: No targets found.
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:12:34 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:12:34 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9181b90d-b12e-4bfa-b727-56b22a3940df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab0656-873e-4816-9479-e5611542f834]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:34 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59102792d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No VIF found with MAC fa:16:3e:b1:73:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb032ef6-ab71-41cb-bd30-c2ecdc875efb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c11113-499b-4e3f-a29f-7ae3ae385d2a]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cfdf37-b20e-45a7-a915-2eb345b08a7c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841773c-6449-4ae0-ae20-99b41c21345a]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd17e97-56da-493a-86fa-e1f939990155]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-48956563-7fe8-40fe-989b-98392d45bd33 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.760s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42417776-6000-4730-979b-17b586790990]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260]
Jul 26 17:12:34 user nova-compute[70594]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f, portal: 172.16.0.220,3260] successful.
Jul 26 17:12:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14216eeb-e0b3-47c2-b5f6-10496a11d60f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[874fadef-09e5-4163-a90d-d07d363f281d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] <== disconnect_volume: return (687ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing instance network info cache due to event network-changed-0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] Acquiring lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] Acquired lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:12:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Refreshing network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:12:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updated VIF entry in instance network info cache for port 0106bf37-b840-4629-81e8-a1df185a2cc2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:12:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [{"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:12:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-166bd5bc-5969-409a-940f-abbea1c86883 req-0c56aced-3821-4f8d-89f3-e48ca41e0441 service nova] Releasing lock "refresh_cache-9c7ad527-efb9-4cec-8791-010b7a28eab5" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:12:35 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'flavor' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a2b2d5bd-4ff6-4b42-ba4b-79f83678970e tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.282s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:36 user nova-compute[70594]: INFO nova.compute.manager [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Detaching volume e5e73414-71d9-4e12-aec9-996fb98846e2
Jul 26 17:12:36 user nova-compute[70594]: INFO nova.virt.block_device [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attempting to driver detach volume e5e73414-71d9-4e12-aec9-996fb98846e2 from mountpoint /dev/vdb
Jul 26 17:12:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Attempting to detach device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:12:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:36 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:36 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:12:36 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:36 user nova-compute[70594]:   <serial>e5e73414-71d9-4e12-aec9-996fb98846e2</serial>
Jul 26 17:12:36 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:12:36 user nova-compute[70594]: </disk>
Jul 26 17:12:36 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:36 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config.
Jul 26 17:12:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:12:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:12:36 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:12:36 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:12:36 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:12:36 user nova-compute[70594]:   <serial>e5e73414-71d9-4e12-aec9-996fb98846e2</serial>
Jul 26 17:12:36 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:12:36 user nova-compute[70594]: </disk>
Jul 26 17:12:36 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391557.404758, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:12:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config.
Jul 26 17:12:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDCxeEqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:12:37 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0fabff-3734-4185-8e93-2806d0d54b8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:12:37 user nova-compute[70594]: No targets found.
Jul 26 17:12:37 user nova-compute[70594]: iSNS:
Jul 26 17:12:37 user nova-compute[70594]: No targets found.
Jul 26 17:12:37 user nova-compute[70594]: STATIC:
Jul 26 17:12:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2
Jul 26 17:12:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:12:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:12:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:12:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:12:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:12:37 user nova-compute[70594]: FIRMWARE:
Jul 26 17:12:37 user nova-compute[70594]: No targets found.
Jul 26 17:12:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:12:37 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:12:37 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05afdc59-0ccc-4a64-88a8-234856b77e9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de8d42-8362-425a-8ef0-8fee436c6048]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:37 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:37 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:37 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:12:37 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:12:37 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:12:37 user nova-compute[70594]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 (non-flash)
Jul 26 17:12:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5918167400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8adab7-c18b-473d-8251-dd887d6b70bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e5f65-f0b1-464d-bdd2-7569d553d087]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eafb58b-b175-4f17-94f3-9c64bb6a17ef]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[891ac110-d4e8-4019-a899-759327a15b7a]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d6e44-4630-4806-9676-151da7573034]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e3cdb-6459-4d7b-a3c6-c75ea784b6a6]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260]
Jul 26 17:12:37 user nova-compute[70594]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2, portal: 172.16.0.220,3260] successful.
Jul 26 17:12:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5e73414-71d9-4e12-aec9-996fb98846e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d46a78b-c93f-4eb2-af4b-55369a0f6d4d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== disconnect_volume: return (320ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:12:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:12:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9a834c00-8378-41ff-9b4b-7e37936d3798 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.918s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1c86b49f-674b-4e58-81bc-e7ec9935bc5d tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70594) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG nova.objects.instance [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-882929bc-18c4-4bf7-af50-a8833752f087 req-5de0382b-dacf-42e5-804e-ce7bbb413f08 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-882929bc-18c4-4bf7-af50-a8833752f087 req-5de0382b-dacf-42e5-804e-ce7bbb413f08 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-882929bc-18c4-4bf7-af50-a8833752f087 req-5de0382b-dacf-42e5-804e-ce7bbb413f08 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-882929bc-18c4-4bf7-af50-a8833752f087 req-5de0382b-dacf-42e5-804e-ce7bbb413f08 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-882929bc-18c4-4bf7-af50-a8833752f087 req-5de0382b-dacf-42e5-804e-ce7bbb413f08 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:12:39 user nova-compute[70594]: WARNING nova.compute.manager [req-882929bc-18c4-4bf7-af50-a8833752f087 req-5de0382b-dacf-42e5-804e-ce7bbb413f08 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state active and task_state powering-off.
Jul 26 17:12:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance destroyed successfully.
Jul 26 17:12:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:12:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-81ff8910-09b1-42ab-aec7-f47a67528a6c tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.879s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-ebd96000-8955-4cd9-a84d-7e208eb8c952 req-228421c9-4ce6-492e-9685-1ded67b674d7 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:12:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ebd96000-8955-4cd9-a84d-7e208eb8c952 req-228421c9-4ce6-492e-9685-1ded67b674d7 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ebd96000-8955-4cd9-a84d-7e208eb8c952 req-228421c9-4ce6-492e-9685-1ded67b674d7 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ebd96000-8955-4cd9-a84d-7e208eb8c952 req-228421c9-4ce6-492e-9685-1ded67b674d7 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:12:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-ebd96000-8955-4cd9-a84d-7e208eb8c952 req-228421c9-4ce6-492e-9685-1ded67b674d7 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:12:41 user nova-compute[70594]: WARNING nova.compute.manager [req-ebd96000-8955-4cd9-a84d-7e208eb8c952 req-228421c9-4ce6-492e-9685-1ded67b674d7 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state stopped and task_state None.
Jul 26 17:12:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:12:54 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391559.89167, 35205a75-e9a7-49a5-96f8-57631680ca05 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:12:54 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Stopped (Lifecycle Event)
Jul 26 17:12:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d3e6d624-a4ed-4116-b219-ef0d7d230066 None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:12:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d3e6d624-a4ed-4116-b219-ef0d7d230066 None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:12:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:12:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:12:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:12:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:12:59 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:12:59 user nova-compute[70594]: INFO nova.compute.claims [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Claim successful on node user
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:13:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:13:00 user nova-compute[70594]: INFO nova.virt.block_device [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Booting with volume-backed-image eb0188fe-f507-4fcc-b390-0fd03c1cea08 at /dev/vda
Jul 26 17:13:00 user nova-compute[70594]: DEBUG nova.policy [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6af9ec8d9d644c89ba32c10861afba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd253357a8f7b42119a7b91385afa0e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:13:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Successfully created port: 96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:13:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Successfully updated port: 96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-changed-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Refreshing instance network info cache due to event network-changed-96fad621-8fa0-44df-af0b-0d07cbad2013. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] Acquiring lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating instance_info_cache with network_info: [{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance network_info: |[{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] Acquired lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Refreshing network info cache for port 96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:02 user nova-compute[70594]: INFO nova.compute.manager [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Detaching volume b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:13:03 user nova-compute[70594]: INFO nova.virt.block_device [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Attempting to driver detach volume b7579ffb-498a-41ad-944a-b1f1e5fa42f2 from mountpoint /dev/vdb
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Attempting to detach device vdb from instance f6206aea-d091-4f94-97cc-bb940e53a699 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:13:03 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:03 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:13:03 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:03 user nova-compute[70594]:   <serial>b7579ffb-498a-41ad-944a-b1f1e5fa42f2</serial>
Jul 26 17:13:03 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:13:03 user nova-compute[70594]: </disk>
Jul 26 17:13:03 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:13:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully detached device vdb from instance f6206aea-d091-4f94-97cc-bb940e53a699 from the persistent domain config.
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6206aea-d091-4f94-97cc-bb940e53a699 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:13:03 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:03 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:13:03 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:03 user nova-compute[70594]:   <serial>b7579ffb-498a-41ad-944a-b1f1e5fa42f2</serial>
Jul 26 17:13:03 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:13:03 user nova-compute[70594]: </disk>
Jul 26 17:13:03 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updated VIF entry in instance network info cache for port 96fad621-8fa0-44df-af0b-0d07cbad2013. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating instance_info_cache with network_info: [{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-33ab808c-0ee8-425c-bdeb-303c04eaaa89 req-83bb2370-11be-4943-ad69-b833c170a7e8 service nova] Releasing lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391583.658997, f6206aea-d091-4f94-97cc-bb940e53a699 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:13:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully detached device vdb from instance f6206aea-d091-4f94-97cc-bb940e53a699 from the live domain config.
Jul 26 17:13:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYcoqAsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:03 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5397de9-d426-4c7b-9806-6706b4b710c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:13:03 user nova-compute[70594]: No targets found.
Jul 26 17:13:03 user nova-compute[70594]: iSNS:
Jul 26 17:13:03 user nova-compute[70594]: No targets found.
Jul 26 17:13:03 user nova-compute[70594]: STATIC:
Jul 26 17:13:03 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:13:03 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:03 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:03 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2
Jul 26 17:13:03 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:03 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:03 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:13:03 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:03 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:03 user nova-compute[70594]: FIRMWARE:
Jul 26 17:13:03 user nova-compute[70594]: No targets found.
Jul 26 17:13:03 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:13:03 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:13:03 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4209ca-8e32-4e78-ac67-703ee1295be1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b6504-b39f-4fb8-9f34-045164a17372]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:03 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:13:03 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:03 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:03 user nova-compute[70594]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 (non-flash)
Jul 26 17:13:03 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:03 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591027a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2'): ({'sdf'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Removing single pathed devices sdf {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c1aa36-a053-47f5-b6e7-a0919f3dfd28]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[006582c2-6516-4cad-b6ac-0a528b002479]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flushing IO for device /dev/sdf {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8291229-d9af-47f1-b4a8-1f3f8bcc48a4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c994b50-9b8d-49c0-830b-40f291d2f371]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0ed580-ea75-4ec8-bc88-6b2be47209e3]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c703c-53d6-4dd2-9763-1d502487984f]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260]
Jul 26 17:13:03 user nova-compute[70594]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2, portal: 172.16.0.220,3260] successful.
Jul 26 17:13:03 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:03 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7579ffb-498a-41ad-944a-b1f1e5fa42f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b7636-4ced-4b15-8ee7-7e6f2b19bf49]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== disconnect_volume: return (336ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f8448fad-15fb-4ddb-b78d-fbb9c2c9c953 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.852s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.utils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[630ad444-6831-478f-a4f0-0a6a1229441a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e354edfe-c2c4-47ac-b523-a509221025a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:06 user nova-compute[70594]: INFO nova.compute.manager [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Unshelving
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc49f5-8a61-464f-873b-f27ced0d2d6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e961ae4c-1014-4d60-96a5-a6c5b9571bc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:13:06 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[321e0e8c-8de6-40f1-8078-00f628b7cd91]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.utils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating existing volume attachment record: e426cba3-0567-44bc-ada3-9a2d5c47ce3a {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:13:06 user nova-compute[70594]: INFO nova.virt.block_device [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Booting with volume 714be488-518b-47e6-addb-15122230f336 at /dev/vda
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.utils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c9ae6-94ff-4823-90b1-4ceada88dafb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a073d36-9791-4599-94aa-85986b4b8d76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4873fe-0358-43bd-ae54-26cce5f69d5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7652f02f-d84e-455a-9469-5f73cf489466]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:13:06 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:13:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ef1508-38d5-42bd-842e-5ac50ac6ed0a]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG os_brick.utils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating existing volume attachment record: 82369623-83d8-44d5-8b48-7b4913f5ec38 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:13:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:09 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:09 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:13:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.093875885009766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:13:14 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Creating image(s)
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Ensure instance console log exists: /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Start _get_guest_xml network_info=[{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa0cbb71-bab6-4f6a-afa1-24c26c851f9f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba580e59-b834-4cd1-99e8-48693d0ed8af', 'serial': 'ba580e59-b834-4cd1-99e8-48693d0ed8af'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'e426cba3-0567-44bc-ada3-9a2d5c47ce3a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:13:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:13:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:14 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:14 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:14 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f6206aea-d091-4f94-97cc-bb940e53a699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 7198cc04-ff6c-4a24-8e4f-e5db85060811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c6f33-74a7-4dfa-9d43-809309f1911f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:13:14 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 636d93f0-fdb5-46bc-8835-d35298ad7afb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1726}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[31abe48b-a3a9-4b4a-a47a-725b16c99b71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af] added
Jul 26 17:13:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e89071-0d26-4ca1-9ad3-33ce7bd69d53]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afc1f7-8b9a-40be-8d87-01461816283b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvGYnOpH {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvGYnOpH" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c57ecf-dc9c-46e6-846e-26b0b5f2750e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IvGYnOpH'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d1be14-ab86-4041-8460-01753f3a0ee2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ced85fd-260a-4dc4-9e6f-d81a36e372c4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:14 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:14 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc4b83-5e4e-4003-ae60-06a801737d6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260]
Jul 26 17:13:14 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260] successful.
Jul 26 17:13:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d78350-2f50-4e06-8129-6c36aeba49d6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc71015-a3e7-439a-97f1-4335a377944c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:14 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:14 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:14 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:14 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:14 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b14bc-b9d3-4a89-8f7f-58ee3c645f76]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.479s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.objects.instance [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'pci_requests' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.objects.instance [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'numa_topology' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:13:14 user nova-compute[70594]: INFO nova.compute.claims [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Claim successful on node user
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:15 user nova-compute[70594]: INFO nova.network.neutron [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating port 8a2bebe0-90e3-4160-a03d-f8548a907a0f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23461326461373738', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461326461373738', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-571158116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-571158116',id=34,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-7dvuw2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:13:00Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=aa0cbb71-bab6-4f6a-afa1-24c26c851f9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'pci_devices' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:13:15 user nova-compute[70594]:   <uuid>aa0cbb71-bab6-4f6a-afa1-24c26c851f9f</uuid>
Jul 26 17:13:15 user nova-compute[70594]:   <name>instance-00000022</name>
Jul 26 17:13:15 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:13:15 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:13:15 user nova-compute[70594]:   <metadata>
Jul 26 17:13:15 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:13:15 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:13:15 user nova-compute[70594]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-571158116</nova:name>
Jul 26 17:13:15 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:13:14</nova:creationTime>
Jul 26 17:13:15 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:13:15 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:13:15 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:13:15 user nova-compute[70594]:       <nova:owner>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:user uuid="f6af9ec8d9d644c89ba32c10861afba2">tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member</nova:user>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:project uuid="d253357a8f7b42119a7b91385afa0e8b">tempest-ServerBootFromVolumeStableRescueTest-43751456</nova:project>
Jul 26 17:13:15 user nova-compute[70594]:       </nova:owner>
Jul 26 17:13:15 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:13:15 user nova-compute[70594]:       <nova:ports>
Jul 26 17:13:15 user nova-compute[70594]:         <nova:port uuid="96fad621-8fa0-44df-af0b-0d07cbad2013">
Jul 26 17:13:15 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:13:15 user nova-compute[70594]:         </nova:port>
Jul 26 17:13:15 user nova-compute[70594]:       </nova:ports>
Jul 26 17:13:15 user nova-compute[70594]:     </nova:instance>
Jul 26 17:13:15 user nova-compute[70594]:   </metadata>
Jul 26 17:13:15 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:13:15 user nova-compute[70594]:     <system>
Jul 26 17:13:15 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:13:15 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:13:15 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:13:15 user nova-compute[70594]:       <entry name="serial">aa0cbb71-bab6-4f6a-afa1-24c26c851f9f</entry>
Jul 26 17:13:15 user nova-compute[70594]:       <entry name="uuid">aa0cbb71-bab6-4f6a-afa1-24c26c851f9f</entry>
Jul 26 17:13:15 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:13:15 user nova-compute[70594]:     </system>
Jul 26 17:13:15 user nova-compute[70594]:   </sysinfo>
Jul 26 17:13:15 user nova-compute[70594]:   <os>
Jul 26 17:13:15 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:13:15 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:13:15 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:13:15 user nova-compute[70594]:   </os>
Jul 26 17:13:15 user nova-compute[70594]:   <features>
Jul 26 17:13:15 user nova-compute[70594]:     <acpi/>
Jul 26 17:13:15 user nova-compute[70594]:     <apic/>
Jul 26 17:13:15 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:13:15 user nova-compute[70594]:   </features>
Jul 26 17:13:15 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:13:15 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:13:15 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:13:15 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:13:15 user nova-compute[70594]:   </clock>
Jul 26 17:13:15 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:13:15 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:13:15 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:13:15 user nova-compute[70594]:   </cpu>
Jul 26 17:13:15 user nova-compute[70594]:   <devices>
Jul 26 17:13:15 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:13:15 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:15 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 17:13:15 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:13:15 user nova-compute[70594]:       <serial>ba580e59-b834-4cd1-99e8-48693d0ed8af</serial>
Jul 26 17:13:15 user nova-compute[70594]:     </disk>
Jul 26 17:13:15 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:13:15 user nova-compute[70594]:       <mac address="fa:16:3e:d0:76:ac"/>
Jul 26 17:13:15 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:13:15 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:13:15 user nova-compute[70594]:       <target dev="tap96fad621-8f"/>
Jul 26 17:13:15 user nova-compute[70594]:     </interface>
Jul 26 17:13:15 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:13:15 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/console.log" append="off"/>
Jul 26 17:13:15 user nova-compute[70594]:     </serial>
Jul 26 17:13:15 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:13:15 user nova-compute[70594]:     <video>
Jul 26 17:13:15 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:13:15 user nova-compute[70594]:     </video>
Jul 26 17:13:15 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:13:15 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:13:15 user nova-compute[70594]:     </rng>
Jul 26 17:13:15 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:13:15 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:13:15 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:13:15 user nova-compute[70594]:     </memballoon>
Jul 26 17:13:15 user nova-compute[70594]:   </devices>
Jul 26 17:13:15 user nova-compute[70594]: </domain>
Jul 26 17:13:15 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-571158116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-571158116',id=34,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-7dvuw2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:13:00Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=aa0cbb71-bab6-4f6a-afa1-24c26c851f9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG os_vif [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96fad621-8f, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96fad621-8f, col_values=(('external_ids', {'iface-id': '96fad621-8fa0-44df-af0b-0d07cbad2013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:76:ac', 'vm-uuid': 'aa0cbb71-bab6-4f6a-afa1-24c26c851f9f'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:15 user nova-compute[70594]: INFO os_vif [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f')
Jul 26 17:13:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No VIF found with MAC fa:16:3e:d0:76:ac, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:13:15 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing instance network info cache due to event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [{"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:13:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.network.neutron [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:13:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Creating image(s)
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Ensure instance console log exists: /opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Start _get_guest_xml network_info=[{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '636d93f0-fdb5-46bc-8835-d35298ad7afb', 'attached_at': '', 'detached_at': '', 'volume_id': '714be488-518b-47e6-addb-15122230f336', 'serial': '714be488-518b-47e6-addb-15122230f336'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '82369623-83d8-44d5-8b48-7b4913f5ec38', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.network.neutron [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:13:17 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:13:17 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.objects.instance [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'vcpu_model' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:17 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:17 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:17 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f7301-565b-4a65-8ae3-0444f68755f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:13:17 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2178b6d-0bb8-4cf2-a5be-aa3ce50127e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336] added
Jul 26 17:13:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c5ea6-cf44-4a47-9b84-3fb0d2f6b0e7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3caf1c-3eed-4ed5-8394-39dfdd21979d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmBQihHp {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmBQihHp" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f61449-5097-479f-ab1f-54745adcb0ef]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmBQihHp'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cbe89c-4875-419b-9f53-a3ba6503da71]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba73faa-29cd-43eb-9231-0110be9c7a0a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[211953b7-09d9-4d06-8e5d-2af767ce0631]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]
Jul 26 17:13:17 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.
Jul 26 17:13:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-0e520295-5ed3-411d-a6c2-dcefda4ce81d req-ae91b1bd-195d-4986-ac03-b5befb18bf9a service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0e520295-5ed3-411d-a6c2-dcefda4ce81d req-ae91b1bd-195d-4986-ac03-b5befb18bf9a service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0e520295-5ed3-411d-a6c2-dcefda4ce81d req-ae91b1bd-195d-4986-ac03-b5befb18bf9a service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0e520295-5ed3-411d-a6c2-dcefda4ce81d req-ae91b1bd-195d-4986-ac03-b5befb18bf9a service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-0e520295-5ed3-411d-a6c2-dcefda4ce81d req-ae91b1bd-195d-4986-ac03-b5befb18bf9a service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:17 user nova-compute[70594]: WARNING nova.compute.manager [req-0e520295-5ed3-411d-a6c2-dcefda4ce81d req-ae91b1bd-195d-4986-ac03-b5befb18bf9a service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state building and task_state spawning.
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46aaf55-73a6-4695-8b2b-e96f24045617]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a79300-231a-4cdb-b04f-f76ae93ce5a2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:17 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:17 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff06b35-f273-4ac2-b82e-5375b307c649]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.network.neutron [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updated VIF entry in instance network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG nova.network.neutron [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6b20a19a-f96a-4e49-9836-fc3515c81cf4 req-713c65aa-7b71-4ae4-b471-6a07273cf803 service nova] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23839313232333634', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839313232333634', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1924341254',display_name='tempest-TestShelveInstance-server-1924341254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1924341254',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-284998996',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c7f2f383f3f49f89a60c1d12e7e0102',ramdisk_id='',reservation_id='r-0ksxqzxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-448703386',owner_user_name='tempest-TestShelveInstance-448703386-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:13:06Z,user_data=None,user_id='59ec9b7626b3434ca0a3b14075902993',uuid=636d93f0-fdb5-46bc-8835-d35298ad7afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converting VIF {"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.objects.instance [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'pci_devices' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:13:18 user nova-compute[70594]:   <uuid>636d93f0-fdb5-46bc-8835-d35298ad7afb</uuid>
Jul 26 17:13:18 user nova-compute[70594]:   <name>instance-0000001f</name>
Jul 26 17:13:18 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:13:18 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:13:18 user nova-compute[70594]:   <metadata>
Jul 26 17:13:18 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:13:18 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:13:18 user nova-compute[70594]:       <nova:name>tempest-TestShelveInstance-server-1924341254</nova:name>
Jul 26 17:13:18 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:13:17</nova:creationTime>
Jul 26 17:13:18 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:13:18 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:13:18 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:13:18 user nova-compute[70594]:       <nova:owner>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:user uuid="59ec9b7626b3434ca0a3b14075902993">tempest-TestShelveInstance-448703386-project-member</nova:user>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:project uuid="5c7f2f383f3f49f89a60c1d12e7e0102">tempest-TestShelveInstance-448703386</nova:project>
Jul 26 17:13:18 user nova-compute[70594]:       </nova:owner>
Jul 26 17:13:18 user nova-compute[70594]:       <nova:ports>
Jul 26 17:13:18 user nova-compute[70594]:         <nova:port uuid="8a2bebe0-90e3-4160-a03d-f8548a907a0f">
Jul 26 17:13:18 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:13:18 user nova-compute[70594]:         </nova:port>
Jul 26 17:13:18 user nova-compute[70594]:       </nova:ports>
Jul 26 17:13:18 user nova-compute[70594]:     </nova:instance>
Jul 26 17:13:18 user nova-compute[70594]:   </metadata>
Jul 26 17:13:18 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:13:18 user nova-compute[70594]:     <system>
Jul 26 17:13:18 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:13:18 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:13:18 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:13:18 user nova-compute[70594]:       <entry name="serial">636d93f0-fdb5-46bc-8835-d35298ad7afb</entry>
Jul 26 17:13:18 user nova-compute[70594]:       <entry name="uuid">636d93f0-fdb5-46bc-8835-d35298ad7afb</entry>
Jul 26 17:13:18 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:13:18 user nova-compute[70594]:     </system>
Jul 26 17:13:18 user nova-compute[70594]:   </sysinfo>
Jul 26 17:13:18 user nova-compute[70594]:   <os>
Jul 26 17:13:18 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:13:18 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:13:18 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:13:18 user nova-compute[70594]:   </os>
Jul 26 17:13:18 user nova-compute[70594]:   <features>
Jul 26 17:13:18 user nova-compute[70594]:     <acpi/>
Jul 26 17:13:18 user nova-compute[70594]:     <apic/>
Jul 26 17:13:18 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:13:18 user nova-compute[70594]:   </features>
Jul 26 17:13:18 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:13:18 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:13:18 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:13:18 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:13:18 user nova-compute[70594]:   </clock>
Jul 26 17:13:18 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:13:18 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:13:18 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:13:18 user nova-compute[70594]:   </cpu>
Jul 26 17:13:18 user nova-compute[70594]:   <devices>
Jul 26 17:13:18 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:13:18 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:18 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:13:18 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:13:18 user nova-compute[70594]:       <serial>714be488-518b-47e6-addb-15122230f336</serial>
Jul 26 17:13:18 user nova-compute[70594]:     </disk>
Jul 26 17:13:18 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:13:18 user nova-compute[70594]:       <mac address="fa:16:3e:7c:1c:93"/>
Jul 26 17:13:18 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:13:18 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:13:18 user nova-compute[70594]:       <target dev="tap8a2bebe0-90"/>
Jul 26 17:13:18 user nova-compute[70594]:     </interface>
Jul 26 17:13:18 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:13:18 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb/console.log" append="off"/>
Jul 26 17:13:18 user nova-compute[70594]:     </serial>
Jul 26 17:13:18 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:13:18 user nova-compute[70594]:     <video>
Jul 26 17:13:18 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:13:18 user nova-compute[70594]:     </video>
Jul 26 17:13:18 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:13:18 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:13:18 user nova-compute[70594]:     </rng>
Jul 26 17:13:18 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:13:18 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:13:18 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:13:18 user nova-compute[70594]:     </memballoon>
Jul 26 17:13:18 user nova-compute[70594]:   </devices>
Jul 26 17:13:18 user nova-compute[70594]: </domain>
Jul 26 17:13:18 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1924341254',display_name='tempest-TestShelveInstance-server-1924341254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1924341254',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-284998996',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c7f2f383f3f49f89a60c1d12e7e0102',ramdisk_id='',reservation_id='r-0ksxqzxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-448703386',owner_user_name='tempest-TestShelveInstance-448703386-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:13:06Z,user_data=None,user_id='59ec9b7626b3434ca0a3b14075902993',uuid=636d93f0-fdb5-46bc-8835-d35298ad7afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converting VIF {"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG os_vif [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a2bebe0-90, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a2bebe0-90, col_values=(('external_ids', {'iface-id': '8a2bebe0-90e3-4160-a03d-f8548a907a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:1c:93', 'vm-uuid': '636d93f0-fdb5-46bc-8835-d35298ad7afb'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:18 user nova-compute[70594]: INFO os_vif [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90')
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:13:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] No VIF found with MAC fa:16:3e:7c:1c:93, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391599.3132305, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Resumed (Lifecycle Event)
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance spawned successfully.
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391599.314735, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Started (Lifecycle Event)
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Took 5.21 seconds to spawn the instance on the hypervisor.
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-f64599b2-7ab2-4526-923c-3c28d88046e8 req-cdf5f796-f1a5-4841-b0b3-6a2b006e8f00 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f64599b2-7ab2-4526-923c-3c28d88046e8 req-cdf5f796-f1a5-4841-b0b3-6a2b006e8f00 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f64599b2-7ab2-4526-923c-3c28d88046e8 req-cdf5f796-f1a5-4841-b0b3-6a2b006e8f00 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f64599b2-7ab2-4526-923c-3c28d88046e8 req-cdf5f796-f1a5-4841-b0b3-6a2b006e8f00 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-f64599b2-7ab2-4526-923c-3c28d88046e8 req-cdf5f796-f1a5-4841-b0b3-6a2b006e8f00 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:19 user nova-compute[70594]: WARNING nova.compute.manager [req-f64599b2-7ab2-4526-923c-3c28d88046e8 req-cdf5f796-f1a5-4841-b0b3-6a2b006e8f00 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state building and task_state spawning.
Jul 26 17:13:19 user nova-compute[70594]: INFO nova.compute.manager [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Took 20.21 seconds to build instance.
Jul 26 17:13:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a41bb7da-fc16-4511-8f74-a5121519de63 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.308s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-49c04281-6bdb-4d00-a113-15ad0d3152d7 req-eb2cd213-beaf-4df7-a117-7e6e1af41367 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-49c04281-6bdb-4d00-a113-15ad0d3152d7 req-eb2cd213-beaf-4df7-a117-7e6e1af41367 service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-49c04281-6bdb-4d00-a113-15ad0d3152d7 req-eb2cd213-beaf-4df7-a117-7e6e1af41367 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-49c04281-6bdb-4d00-a113-15ad0d3152d7 req-eb2cd213-beaf-4df7-a117-7e6e1af41367 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-49c04281-6bdb-4d00-a113-15ad0d3152d7 req-eb2cd213-beaf-4df7-a117-7e6e1af41367 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:20 user nova-compute[70594]: WARNING nova.compute.manager [req-49c04281-6bdb-4d00-a113-15ad0d3152d7 req-eb2cd213-beaf-4df7-a117-7e6e1af41367 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:20 user nova-compute[70594]: INFO nova.compute.manager [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Terminating instance
Jul 26 17:13:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Instance destroyed successfully.
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.objects.instance [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lazy-loading 'resources' on Instance uuid 7198cc04-ff6c-4a24-8e4f-e5db85060811 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1581202798',display_name='tempest-TestMinimumBasicScenario-server-1581202798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1581202798',id=29,image_ref='a4498700-d662-41ba-b1af-35bdcc3af61a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFFGAJAgPkWshC1RRmM6moKBbgA9DoD5tyRD7WsLZaoMa1EtmIGidJX9qYN5iLLtj8FyjJVfeBsSabHf2Q1ESUlSa6gy584jeO4jIzwNeZMTC3JZMNkr6GPN9HotBFQ+A==',key_name='tempest-TestMinimumBasicScenario-221071219',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:08:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='549ece99958b4c54a8581fe37b3ced92',ramdisk_id='',reservation_id='r-on8dm933',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4498700-d662-41ba-b1af-35bdcc3af61a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1770089512',owner_user_name='tempest-TestMinimumBasicScenario-1770089512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:10:38Z,user_data=None,user_id='522b55c463ac450ebf618c8fdc44a8b5',uuid=7198cc04-ff6c-4a24-8e4f-e5db85060811,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converting VIF {"id": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "address": "fa:16:3e:5c:0b:4c", "network": {"id": "b3576808-e062-484f-8945-405729afaf7d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1453465289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "549ece99958b4c54a8581fe37b3ced92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dcd74b-a2", "ovs_interfaceid": "a2dcd74b-a228-4a88-a0bc-ec8bab9d681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG os_vif [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2dcd74b-a2, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:21 user nova-compute[70594]: INFO os_vif [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:0b:4c,bridge_name='br-int',has_traffic_filtering=True,id=a2dcd74b-a228-4a88-a0bc-ec8bab9d681e,network=Network(b3576808-e062-484f-8945-405729afaf7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dcd74b-a2')
Jul 26 17:13:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Deleting instance files /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811_del
Jul 26 17:13:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Deletion of /opt/stack/data/nova/instances/7198cc04-ff6c-4a24-8e4f-e5db85060811_del complete
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-unplugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-unplugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-unplugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] Acquiring lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] No waiting events found dispatching network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:21 user nova-compute[70594]: WARNING nova.compute.manager [req-2cbe2575-b406-4447-9195-7027fafcd37d req-42a54865-3dc4-43bb-8e6a-46913af2f815 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received unexpected event network-vif-plugged-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e for instance with vm_state active and task_state deleting.
Jul 26 17:13:21 user nova-compute[70594]: INFO nova.compute.manager [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 26 17:13:21 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:13:21 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Took 0.48 seconds to deallocate network for instance.
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:22 user nova-compute[70594]: WARNING nova.compute.manager [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-12453e62-26cd-47f2-acb6-14bca5e861e1 req-61def555-e309-4337-bd96-93e06c138787 service nova] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Received event network-vif-deleted-a2dcd74b-a228-4a88-a0bc-ec8bab9d681e {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391602.4756327, 636d93f0-fdb5-46bc-8835-d35298ad7afb => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:13:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] VM Resumed (Lifecycle Event)
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:13:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance spawned successfully.
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:13:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391602.480609, 636d93f0-fdb5-46bc-8835-d35298ad7afb => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:13:22 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] VM Started (Lifecycle Event)
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-76a1d41c-070f-44e9-a5e7-e90a335224a6 tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.377s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:22 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Deleted allocations for instance 7198cc04-ff6c-4a24-8e4f-e5db85060811
Jul 26 17:13:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f0033f-b4f9-47d2-8478-ceb121e45d8e tempest-TestMinimumBasicScenario-1770089512 tempest-TestMinimumBasicScenario-1770089512-project-member] Lock "7198cc04-ff6c-4a24-8e4f-e5db85060811" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:23 user nova-compute[70594]: INFO nova.compute.manager [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Terminating instance
Jul 26 17:13:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ef81009-c853-46b8-a449-e62fae04814f req-8759b371-087d-43f9-bbe5-dc0c0131a19e service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ef81009-c853-46b8-a449-e62fae04814f req-8759b371-087d-43f9-bbe5-dc0c0131a19e service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ef81009-c853-46b8-a449-e62fae04814f req-8759b371-087d-43f9-bbe5-dc0c0131a19e service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ef81009-c853-46b8-a449-e62fae04814f req-8759b371-087d-43f9-bbe5-dc0c0131a19e service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ef81009-c853-46b8-a449-e62fae04814f req-8759b371-087d-43f9-bbe5-dc0c0131a19e service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ef81009-c853-46b8-a449-e62fae04814f req-8759b371-087d-43f9-bbe5-dc0c0131a19e service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-unplugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:13:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Instance destroyed successfully.
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'resources' on Instance uuid 9c7ad527-efb9-4cec-8791-010b7a28eab5 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-694281953',display_name='tempest-ServerRescueNegativeTestJSON-server-694281953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-694281953',id=26,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQyJw0+WuVC0dgS0L/dqS9Dx4JJ2YwhAgW8IpMVHEBgdmvIUcPFFddQF0iy5DrmLHXPWnbgRkKCOsxhvZyj/aID8CPZlV2RtBC39OTqabWPER9Yz3kSw+9xTF0CZEyF8Q==',key_name='tempest-keypair-268226951',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-adcayqe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=9c7ad527-efb9-4cec-8791-010b7a28eab5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "0106bf37-b840-4629-81e8-a1df185a2cc2", "address": "fa:16:3e:b7:d6:90", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0106bf37-b8", "ovs_interfaceid": "0106bf37-b840-4629-81e8-a1df185a2cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG os_vif [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0106bf37-b8, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:24 user nova-compute[70594]: INFO os_vif [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:90,bridge_name='br-int',has_traffic_filtering=True,id=0106bf37-b840-4629-81e8-a1df185a2cc2,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0106bf37-b8')
Jul 26 17:13:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Deleting instance files /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5_del
Jul 26 17:13:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Deletion of /opt/stack/data/nova/instances/9c7ad527-efb9-4cec-8791-010b7a28eab5_del complete
Jul 26 17:13:24 user nova-compute[70594]: INFO nova.compute.manager [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 26 17:13:24 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:13:24 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:26 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Took 1.13 seconds to deallocate network for instance.
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-100c9990-4899-4878-b2ac-1ac5603d3fe9 req-881e0a55-bad9-4b83-a7c1-1d110aca9b0a service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-deleted-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:26 user nova-compute[70594]: INFO nova.compute.manager [req-100c9990-4899-4878-b2ac-1ac5603d3fe9 req-881e0a55-bad9-4b83-a7c1-1d110aca9b0a service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Neutron deleted interface 0106bf37-b840-4629-81e8-a1df185a2cc2; detaching it from the instance and deleting it from the info cache
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-100c9990-4899-4878-b2ac-1ac5603d3fe9 req-881e0a55-bad9-4b83-a7c1-1d110aca9b0a service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-100c9990-4899-4878-b2ac-1ac5603d3fe9 req-881e0a55-bad9-4b83-a7c1-1d110aca9b0a service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Detach interface failed, port_id=0106bf37-b840-4629-81e8-a1df185a2cc2, reason: Instance 9c7ad527-efb9-4cec-8791-010b7a28eab5 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-1d20ce4f-17ac-4d15-8832-bb51a91d243f req-45928007-40ab-4851-b5f0-886d801ab602 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1d20ce4f-17ac-4d15-8832-bb51a91d243f req-45928007-40ab-4851-b5f0-886d801ab602 service nova] Acquiring lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1d20ce4f-17ac-4d15-8832-bb51a91d243f req-45928007-40ab-4851-b5f0-886d801ab602 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1d20ce4f-17ac-4d15-8832-bb51a91d243f req-45928007-40ab-4851-b5f0-886d801ab602 service nova] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-1d20ce4f-17ac-4d15-8832-bb51a91d243f req-45928007-40ab-4851-b5f0-886d801ab602 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] No waiting events found dispatching network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:26 user nova-compute[70594]: WARNING nova.compute.manager [req-1d20ce4f-17ac-4d15-8832-bb51a91d243f req-45928007-40ab-4851-b5f0-886d801ab602 service nova] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Received unexpected event network-vif-plugged-0106bf37-b840-4629-81e8-a1df185a2cc2 for instance with vm_state deleted and task_state None.
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:26 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Deleted allocations for instance 9c7ad527-efb9-4cec-8791-010b7a28eab5
Jul 26 17:13:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-01cb5327-854a-4ff3-afd3-38f3d446f07c tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "9c7ad527-efb9-4cec-8791-010b7a28eab5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.888s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG nova.objects.instance [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:33 user nova-compute[70594]: INFO nova.compute.manager [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attaching volume 579127ff-0226-40d2-927a-6c0f91ca7b8f to /dev/vdb
Jul 26 17:13:33 user nova-compute[70594]: DEBUG os_brick.utils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da1363-2504-49c6-b0b6-746ca35d5bf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdefe20-62ef-4cb9-a5aa-f7e5688f884d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a302e-7b1c-4f86-97d1-b976474f1008]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f6b22-cb5d-4c2d-8aaf-b6357380a38a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:13:33 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:13:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ed572-50c5-46ca-b237-fcacde921910]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG os_brick.utils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:33 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating existing volume attachment record: ddfc2499-0230-4b52-b4d1-7e0e64573af3 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:13:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:36 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391601.4222007, 7198cc04-ff6c-4a24-8e4f-e5db85060811 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:13:36 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] VM Stopped (Lifecycle Event)
Jul 26 17:13:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a1cceef5-0df7-4101-aa3a-3cf4c76222b9 None None] [instance: 7198cc04-ff6c-4a24-8e4f-e5db85060811] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:39 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391604.806375, 9c7ad527-efb9-4cec-8791-010b7a28eab5 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:13:39 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] VM Stopped (Lifecycle Event)
Jul 26 17:13:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9e31f755-d86b-400e-935f-6fb6957b65c8 None None] [instance: 9c7ad527-efb9-4cec-8791-010b7a28eab5] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:13:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egnstpkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:41 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:41 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:41 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ea6cc-d4a4-49ca-9a26-c6b1272b07d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:13:41 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a8312d-a2bd-4c9c-964c-54ee73f70651]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f] added
Jul 26 17:13:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[190352f4-2587-49fb-845c-9fff57ad80c8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d60f3-d1e2-4f2c-8ade-bd9b38b59d54]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egnstpkl {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egnstpkl" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[adae59b0-4def-429b-a5ae-ec06e8d215cf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egnstpkl'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08d470d-293a-4341-9772-1ac326acaa7b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa017ca-7651-4ca2-8bed-0fa04e1e60a9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abc3b1a-3de4-4b1a-aeec-09dc2438170c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260]
Jul 26 17:13:41 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260] successful.
Jul 26 17:13:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dca624-2a04-4500-b414-c52beb890157]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[26860566-477e-4a96-84e6-d8dde88710d2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f (non-flash)
Jul 26 17:13:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:41 user nova-compute[70594]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f (non-flash)
Jul 26 17:13:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c75d06-8916-4345-a4b1-4346e3b8f126]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:13:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egnstpkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23737343534626462', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737343534626462', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:13:42 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:42 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:13:42 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:42 user nova-compute[70594]:   <serial>579127ff-0226-40d2-927a-6c0f91ca7b8f</serial>
Jul 26 17:13:42 user nova-compute[70594]: </disk>
Jul 26 17:13:42 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:13:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No VIF found with MAC fa:16:3e:b1:73:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:13:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-13b69879-6569-43f2-b11c-a8e62ade398a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.597s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:45 user nova-compute[70594]: INFO nova.compute.manager [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Detaching volume 579127ff-0226-40d2-927a-6c0f91ca7b8f
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.compute.manager [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Detaching volume 55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.virt.block_device [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attempting to driver detach volume 579127ff-0226-40d2-927a-6c0f91ca7b8f from mountpoint /dev/vdb
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Attempting to detach device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:13:46 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:46 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:13:46 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:46 user nova-compute[70594]:   <serial>579127ff-0226-40d2-927a-6c0f91ca7b8f</serial>
Jul 26 17:13:46 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:13:46 user nova-compute[70594]: </disk>
Jul 26 17:13:46 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config.
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:13:46 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:46 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:13:46 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:46 user nova-compute[70594]:   <serial>579127ff-0226-40d2-927a-6c0f91ca7b8f</serial>
Jul 26 17:13:46 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:13:46 user nova-compute[70594]: </disk>
Jul 26 17:13:46 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.virt.block_device [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Attempting to driver detach volume 55a33e78-bc12-4d1c-9496-0730f75db71a from mountpoint /dev/vdb
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Attempting to detach device vdb from instance 6bd16164-caa5-442a-b55c-f84119c36256 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:13:46 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:46 user nova-compute[70594]:   <source dev="/dev/sdi"/>
Jul 26 17:13:46 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:46 user nova-compute[70594]:   <serial>55a33e78-bc12-4d1c-9496-0730f75db71a</serial>
Jul 26 17:13:46 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:13:46 user nova-compute[70594]: </disk>
Jul 26 17:13:46 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully detached device vdb from instance 6bd16164-caa5-442a-b55c-f84119c36256 from the persistent domain config.
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6bd16164-caa5-442a-b55c-f84119c36256 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:13:46 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:13:46 user nova-compute[70594]:   <source dev="/dev/sdi"/>
Jul 26 17:13:46 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:13:46 user nova-compute[70594]:   <serial>55a33e78-bc12-4d1c-9496-0730f75db71a</serial>
Jul 26 17:13:46 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 26 17:13:46 user nova-compute[70594]: </disk>
Jul 26 17:13:46 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391626.5929782, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config.
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egnstpkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:46 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22686306-0c1c-46d3-b37b-1553281c9cea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:13:46 user nova-compute[70594]: No targets found.
Jul 26 17:13:46 user nova-compute[70594]: iSNS:
Jul 26 17:13:46 user nova-compute[70594]: No targets found.
Jul 26 17:13:46 user nova-compute[70594]: STATIC:
Jul 26 17:13:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:13:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:13:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:13:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f
Jul 26 17:13:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:13:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:46 user nova-compute[70594]: FIRMWARE:
Jul 26 17:13:46 user nova-compute[70594]: No targets found.
Jul 26 17:13:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:13:46 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:13:46 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8395c9-10f9-44bf-ae6b-d5d97bcbcc0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c55cb5-3268-4f1a-a088-45f82b604dfe]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f (non-flash)
Jul 26 17:13:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:46 user nova-compute[70594]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f (non-flash)
Jul 26 17:13:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59199c2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17818b1-cfd1-4574-8cac-234786d55493]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c4045-f296-461b-87ea-e047a09c7661]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b7bbf-a560-417f-ae72-219cb927f255]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647e72e-d384-4fd3-befb-dc4c526afd23]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c3a93-c502-424e-9b16-a8d4c39c5923]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391626.9217982, 6bd16164-caa5-442a-b55c-f84119c36256 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:13:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully detached device vdb from instance 6bd16164-caa5-442a-b55c-f84119c36256 from the live domain config.
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd8d09-15a8-4ec1-b530-57ed4863b2a1]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260]
Jul 26 17:13:46 user nova-compute[70594]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f, portal: 172.16.0.220,3260] successful.
Jul 26 17:13:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnlOEria', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:13:46 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579127ff-0226-40d2-927a-6c0f91ca7b8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b795b16-3fb8-42f5-81f1-bc0419ae1e16]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== disconnect_volume: return (376ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.043s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:13:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d891cbd0-fb50-4c78-ae1e-b03397c0ec00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:13:47 user nova-compute[70594]: No targets found.
Jul 26 17:13:47 user nova-compute[70594]: iSNS:
Jul 26 17:13:47 user nova-compute[70594]: No targets found.
Jul 26 17:13:47 user nova-compute[70594]: STATIC:
Jul 26 17:13:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:13:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:13:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:13:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:47 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a
Jul 26 17:13:47 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:13:47 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:13:47 user nova-compute[70594]: FIRMWARE:
Jul 26 17:13:47 user nova-compute[70594]: No targets found.
Jul 26 17:13:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:13:47 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:13:47 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bbdb4e-8e48-4401-b98d-691d2822845e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f226a-1727-481e-abc1-38481ce96baa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:47 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:47 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:47 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:13:47 user nova-compute[70594]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a (non-flash)
Jul 26 17:13:47 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:13:47 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:13:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5900520a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a'): ({'sdi'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Removing single pathed devices sdi {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba6e7d-e791-4a29-80ac-97798d40ba1e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[de303978-0a85-4c89-bc99-8e43c554cd8a]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flushing IO for device /dev/sdi {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20b80a-f21b-4602-8861-ddd7db3f6af8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064993a-028e-44b4-80b1-88b289fff8c5]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] SCSI volumes sdi have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[668d0ea1-3030-4d72-a631-0ecd2a58ee61]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea57f767-d9e6-4045-80ba-c81e2412d7fa]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260]
Jul 26 17:13:47 user nova-compute[70594]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a, portal: 172.16.0.220,3260] successful.
Jul 26 17:13:47 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a33e78-bc12-4d1c-9496-0730f75db71a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf05caa-768f-4dd6-90ab-5ffbd54ea32e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== disconnect_volume: return (429ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dfd5a4c-ec5f-4570-8f32-5cb0bb005d8c tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.032s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:48 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'flavor' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1d869a4d-0862-43fb-b903-ad8a30528274 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.192s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:53 user nova-compute[70594]: INFO nova.compute.manager [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Terminating instance
Jul 26 17:13:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-a2fb1dc6-5b01-4d51-b0d7-d68dbc5e7500 req-39d9d0c0-c0bb-47d4-a27c-e52904f09a59 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-vif-unplugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a2fb1dc6-5b01-4d51-b0d7-d68dbc5e7500 req-39d9d0c0-c0bb-47d4-a27c-e52904f09a59 service nova] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a2fb1dc6-5b01-4d51-b0d7-d68dbc5e7500 req-39d9d0c0-c0bb-47d4-a27c-e52904f09a59 service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a2fb1dc6-5b01-4d51-b0d7-d68dbc5e7500 req-39d9d0c0-c0bb-47d4-a27c-e52904f09a59 service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-a2fb1dc6-5b01-4d51-b0d7-d68dbc5e7500 req-39d9d0c0-c0bb-47d4-a27c-e52904f09a59 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] No waiting events found dispatching network-vif-unplugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-a2fb1dc6-5b01-4d51-b0d7-d68dbc5e7500 req-39d9d0c0-c0bb-47d4-a27c-e52904f09a59 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-vif-unplugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:13:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Instance destroyed successfully.
Jul 26 17:13:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'resources' on Instance uuid f6206aea-d091-4f94-97cc-bb940e53a699 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-464258922',display_name='tempest-AttachVolumeNegativeTest-server-464258922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-464258922',id=28,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ98/MMSWgjqKXeSi9j/Fai7pXUadQ2/mOTYijeirFittceow8Ed6ajJx5HyetHhTnyugsxEQlXaV+pnRLJonybV3hxTyXCzcMJb+sRdheCyBn0BwrGHf8kxTujBmgXjrw==',key_name='tempest-keypair-813831144',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-d4gk06vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=f6206aea-d091-4f94-97cc-bb940e53a699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "address": "fa:16:3e:a5:23:44", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af76f49-4e", "ovs_interfaceid": "2af76f49-4e55-49ae-a1c4-b4d30309ff95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG os_vif [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2af76f49-4e, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:54 user nova-compute[70594]: INFO os_vif [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:23:44,bridge_name='br-int',has_traffic_filtering=True,id=2af76f49-4e55-49ae-a1c4-b4d30309ff95,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af76f49-4e')
Jul 26 17:13:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Deleting instance files /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699_del
Jul 26 17:13:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Deletion of /opt/stack/data/nova/instances/f6206aea-d091-4f94-97cc-bb940e53a699_del complete
Jul 26 17:13:54 user nova-compute[70594]: INFO nova.compute.manager [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 26 17:13:54 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:13:54 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:13:55 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Took 1.25 seconds to deallocate network for instance.
Jul 26 17:13:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-d96be996-7c99-4189-aed8-fbc9977a2da8 req-d5291a1d-b2e2-4c1b-9dae-3cc9fda45a30 service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-vif-deleted-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-cd66f3dd-a148-4b47-8af9-88aee54fa4a3 req-c15400c8-c9a3-4db3-ac79-db37eb6bc72b service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received event network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cd66f3dd-a148-4b47-8af9-88aee54fa4a3 req-c15400c8-c9a3-4db3-ac79-db37eb6bc72b service nova] Acquiring lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cd66f3dd-a148-4b47-8af9-88aee54fa4a3 req-c15400c8-c9a3-4db3-ac79-db37eb6bc72b service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cd66f3dd-a148-4b47-8af9-88aee54fa4a3 req-c15400c8-c9a3-4db3-ac79-db37eb6bc72b service nova] Lock "f6206aea-d091-4f94-97cc-bb940e53a699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-cd66f3dd-a148-4b47-8af9-88aee54fa4a3 req-c15400c8-c9a3-4db3-ac79-db37eb6bc72b service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] No waiting events found dispatching network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:13:55 user nova-compute[70594]: WARNING nova.compute.manager [req-cd66f3dd-a148-4b47-8af9-88aee54fa4a3 req-c15400c8-c9a3-4db3-ac79-db37eb6bc72b service nova] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Received unexpected event network-vif-plugged-2af76f49-4e55-49ae-a1c4-b4d30309ff95 for instance with vm_state deleted and task_state None.
Jul 26 17:13:56 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:56 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:56 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Deleted allocations for instance f6206aea-d091-4f94-97cc-bb940e53a699
Jul 26 17:13:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-84ce08b8-ce08-4968-8544-5f2efd710b52 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "f6206aea-d091-4f94-97cc-bb940e53a699" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "f74ff2a1-d268-4472-a284-462f00a1d251" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:13:59 user nova-compute[70594]: INFO nova.compute.claims [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Claim successful on node user
Jul 26 17:13:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:13:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:13:59 user nova-compute[70594]: INFO nova.virt.block_device [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Booting with volume snapshot cab9cf55-a23e-408a-b156-cee8b9a91998 at /dev/vda
Jul 26 17:13:59 user nova-compute[70594]: DEBUG nova.policy [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd221b17924ce3b9770c36fbbb52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f39be2f463416faaeae34d088bb57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:14:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Successfully created port: 37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Successfully updated port: 37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "refresh_cache-f74ff2a1-d268-4472-a284-462f00a1d251" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquired lock "refresh_cache-f74ff2a1-d268-4472-a284-462f00a1d251" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-changed-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.compute.manager [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Refreshing instance network info cache due to event network-changed-37d712eb-9a39-48fc-bec5-8d9f42aab275. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] Acquiring lock "refresh_cache-f74ff2a1-d268-4472-a284-462f00a1d251" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Updating instance_info_cache with network_info: [{"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Releasing lock "refresh_cache-f74ff2a1-d268-4472-a284-462f00a1d251" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Instance network_info: |[{"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] Acquired lock "refresh_cache-f74ff2a1-d268-4472-a284-462f00a1d251" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Refreshing network info cache for port 37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:14:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Updated VIF entry in instance network info cache for port 37d712eb-9a39-48fc-bec5-8d9f42aab275. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:14:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Updating instance_info_cache with network_info: [{"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f7f66892-c3d8-4e11-bd1a-c007d28ccbd7 req-4a47ae30-6a17-4d9c-9706-e8619fc17871 service nova] Releasing lock "refresh_cache-f74ff2a1-d268-4472-a284-462f00a1d251" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:02 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG os_brick.utils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1d506-8fda-4835-9b51-f1a7f99c195d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6422530f-ce34-4bfd-a524-6eabfab0e07a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581a031-c1a5-4100-8bf2-3b9519d225f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7593d5-dcd8-4e10-89cb-fe28718f5572]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:14:05 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:14:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b2a26-4fdc-4c8d-b808-24885b93b8b1]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG os_brick.utils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:05 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Updating existing volume attachment record: 37463587-f8d8-4acc-8561-3e2aec6ed760 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:14:06 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:09 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391634.1824021, f6206aea-d091-4f94-97cc-bb940e53a699 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:09 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] VM Stopped (Lifecycle Event)
Jul 26 17:14:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-abbd2903-b6b9-4f8b-930b-0013f4e6db33 None None] [instance: f6206aea-d091-4f94-97cc-bb940e53a699] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:14:11 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:14:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Creating image(s)
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Ensure instance console log exists: /opt/stack/data/nova/instances/f74ff2a1-d268-4472-a284-462f00a1d251/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Start _get_guest_xml network_info=[{"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzOiKPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f74ff2a1-d268-4472-a284-462f00a1d251', 'attached_at': '', 'detached_at': '', 'volume_id': '3dc6529c-c755-4db5-afab-f636799f4186', 'serial': '3dc6529c-c755-4db5-afab-f636799f4186'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '37463587-f8d8-4acc-8561-3e2aec6ed760', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:14:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzOiKPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:12 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:12 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:12 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb899bfd-b48d-493d-9f81-2514833933ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:14:12 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed15f2a-43a9-487a-b75a-1428d20ccf5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186] added
Jul 26 17:14:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6d6d1e-b854-4c0a-846b-d0e638d131a8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[450549c9-3e3e-4185-bf6b-5343030be3d6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhzOiKPX {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhzOiKPX" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd881ece-5f42-4bd2-a3d1-701840941cf1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EhzOiKPX'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997fc3d-1fda-46a6-85b5-04e5fe09716d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[879a9de6-028d-4130-9b52-e0ac0ce82948]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d90252-b106-4569-aa13-8d3a44ed83c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260]
Jul 26 17:14:12 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260] successful.
Jul 26 17:14:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edc7778-aa6f-4b34-9a62-9931377eb08a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7889bf-37f1-4caf-a7d6-d3c4a5564421]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:12 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29cb22a-98cb-410d-8482-b012240c592a]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzOiKPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23362336437663838', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362336437663838', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-418679531',display_name='tempest-TestVolumeBootPattern-server-418679531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-418679531',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-0m1mplqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:14:00Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=f74ff2a1-d268-4472-a284-462f00a1d251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'pci_devices' on Instance uuid f74ff2a1-d268-4472-a284-462f00a1d251 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:14:13 user nova-compute[70594]:   <uuid>f74ff2a1-d268-4472-a284-462f00a1d251</uuid>
Jul 26 17:14:13 user nova-compute[70594]:   <name>instance-00000023</name>
Jul 26 17:14:13 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:14:13 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:14:13 user nova-compute[70594]:   <metadata>
Jul 26 17:14:13 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:14:13 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:14:13 user nova-compute[70594]:       <nova:name>tempest-TestVolumeBootPattern-server-418679531</nova:name>
Jul 26 17:14:13 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:14:12</nova:creationTime>
Jul 26 17:14:13 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:14:13 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:14:13 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:14:13 user nova-compute[70594]:       <nova:owner>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:user uuid="68fd221b17924ce3b9770c36fbbb52df">tempest-TestVolumeBootPattern-491432484-project-member</nova:user>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:project uuid="05f39be2f463416faaeae34d088bb57c">tempest-TestVolumeBootPattern-491432484</nova:project>
Jul 26 17:14:13 user nova-compute[70594]:       </nova:owner>
Jul 26 17:14:13 user nova-compute[70594]:       <nova:ports>
Jul 26 17:14:13 user nova-compute[70594]:         <nova:port uuid="37d712eb-9a39-48fc-bec5-8d9f42aab275">
Jul 26 17:14:13 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 26 17:14:13 user nova-compute[70594]:         </nova:port>
Jul 26 17:14:13 user nova-compute[70594]:       </nova:ports>
Jul 26 17:14:13 user nova-compute[70594]:     </nova:instance>
Jul 26 17:14:13 user nova-compute[70594]:   </metadata>
Jul 26 17:14:13 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:14:13 user nova-compute[70594]:     <system>
Jul 26 17:14:13 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:14:13 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:14:13 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:14:13 user nova-compute[70594]:       <entry name="serial">f74ff2a1-d268-4472-a284-462f00a1d251</entry>
Jul 26 17:14:13 user nova-compute[70594]:       <entry name="uuid">f74ff2a1-d268-4472-a284-462f00a1d251</entry>
Jul 26 17:14:13 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:14:13 user nova-compute[70594]:     </system>
Jul 26 17:14:13 user nova-compute[70594]:   </sysinfo>
Jul 26 17:14:13 user nova-compute[70594]:   <os>
Jul 26 17:14:13 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:14:13 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:14:13 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:14:13 user nova-compute[70594]:   </os>
Jul 26 17:14:13 user nova-compute[70594]:   <features>
Jul 26 17:14:13 user nova-compute[70594]:     <acpi/>
Jul 26 17:14:13 user nova-compute[70594]:     <apic/>
Jul 26 17:14:13 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:14:13 user nova-compute[70594]:   </features>
Jul 26 17:14:13 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:14:13 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:14:13 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:14:13 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:14:13 user nova-compute[70594]:   </clock>
Jul 26 17:14:13 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:14:13 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:14:13 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:14:13 user nova-compute[70594]:   </cpu>
Jul 26 17:14:13 user nova-compute[70594]:   <devices>
Jul 26 17:14:13 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:14:13 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:14:13 user nova-compute[70594]:       <source dev="/dev/sde"/>
Jul 26 17:14:13 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:14:13 user nova-compute[70594]:       <serial>3dc6529c-c755-4db5-afab-f636799f4186</serial>
Jul 26 17:14:13 user nova-compute[70594]:     </disk>
Jul 26 17:14:13 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:14:13 user nova-compute[70594]:       <mac address="fa:16:3e:f4:d2:54"/>
Jul 26 17:14:13 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:13 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:14:13 user nova-compute[70594]:       <target dev="tap37d712eb-9a"/>
Jul 26 17:14:13 user nova-compute[70594]:     </interface>
Jul 26 17:14:13 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:14:13 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/f74ff2a1-d268-4472-a284-462f00a1d251/console.log" append="off"/>
Jul 26 17:14:13 user nova-compute[70594]:     </serial>
Jul 26 17:14:13 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:14:13 user nova-compute[70594]:     <video>
Jul 26 17:14:13 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:13 user nova-compute[70594]:     </video>
Jul 26 17:14:13 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:14:13 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:14:13 user nova-compute[70594]:     </rng>
Jul 26 17:14:13 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:14:13 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:14:13 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:14:13 user nova-compute[70594]:     </memballoon>
Jul 26 17:14:13 user nova-compute[70594]:   </devices>
Jul 26 17:14:13 user nova-compute[70594]: </domain>
Jul 26 17:14:13 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-418679531',display_name='tempest-TestVolumeBootPattern-server-418679531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-418679531',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-0m1mplqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:14:00Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=f74ff2a1-d268-4472-a284-462f00a1d251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG os_vif [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d712eb-9a, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37d712eb-9a, col_values=(('external_ids', {'iface-id': '37d712eb-9a39-48fc-bec5-8d9f42aab275', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:d2:54', 'vm-uuid': 'f74ff2a1-d268-4472-a284-462f00a1d251'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:13 user nova-compute[70594]: INFO os_vif [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a')
Jul 26 17:14:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No VIF found with MAC fa:16:3e:f4:d2:54, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:14:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=25.211585998535156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 636d93f0-fdb5-46bc-8835-d35298ad7afb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f74ff2a1-d268-4472-a284-462f00a1d251 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-109fabf7-539f-43d6-aaa5-2129307a57e7 req-0dd7a1af-d6a3-423d-b807-188216b60905 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-109fabf7-539f-43d6-aaa5-2129307a57e7 req-0dd7a1af-d6a3-423d-b807-188216b60905 service nova] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-109fabf7-539f-43d6-aaa5-2129307a57e7 req-0dd7a1af-d6a3-423d-b807-188216b60905 service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-109fabf7-539f-43d6-aaa5-2129307a57e7 req-0dd7a1af-d6a3-423d-b807-188216b60905 service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-109fabf7-539f-43d6-aaa5-2129307a57e7 req-0dd7a1af-d6a3-423d-b807-188216b60905 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] No waiting events found dispatching network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:15 user nova-compute[70594]: WARNING nova.compute.manager [req-109fabf7-539f-43d6-aaa5-2129307a57e7 req-0dd7a1af-d6a3-423d-b807-188216b60905 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received unexpected event network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 for instance with vm_state building and task_state spawning.
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.973s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-0c44fb79-63be-44ed-a62c-165929c89bb3 req-6b42f566-5668-4024-a9b5-599e1e8df198 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0c44fb79-63be-44ed-a62c-165929c89bb3 req-6b42f566-5668-4024-a9b5-599e1e8df198 service nova] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0c44fb79-63be-44ed-a62c-165929c89bb3 req-6b42f566-5668-4024-a9b5-599e1e8df198 service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0c44fb79-63be-44ed-a62c-165929c89bb3 req-6b42f566-5668-4024-a9b5-599e1e8df198 service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-0c44fb79-63be-44ed-a62c-165929c89bb3 req-6b42f566-5668-4024-a9b5-599e1e8df198 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] No waiting events found dispatching network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:17 user nova-compute[70594]: WARNING nova.compute.manager [req-0c44fb79-63be-44ed-a62c-165929c89bb3 req-6b42f566-5668-4024-a9b5-599e1e8df198 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received unexpected event network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 for instance with vm_state building and task_state spawning.
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391657.5447655, f74ff2a1-d268-4472-a284-462f00a1d251 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] VM Resumed (Lifecycle Event)
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Instance spawned successfully.
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391657.5486102, f74ff2a1-d268-4472-a284-462f00a1d251 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] VM Started (Lifecycle Event)
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Took 5.32 seconds to spawn the instance on the hypervisor.
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:17 user nova-compute[70594]: INFO nova.compute.manager [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Took 18.69 seconds to build instance.
Jul 26 17:14:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-28bbc59d-133e-4506-9041-bca591fa57b9 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "f74ff2a1-d268-4472-a284-462f00a1d251" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.787s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updating instance_info_cache with network_info: [{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 17:14:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 17:14:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:27 user nova-compute[70594]: INFO nova.compute.manager [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Terminating instance
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-c95356a0-d558-48de-a490-97555ce7e3fc req-a77c1d47-5d30-4a6e-865d-d3b93acfd307 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-unplugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c95356a0-d558-48de-a490-97555ce7e3fc req-a77c1d47-5d30-4a6e-865d-d3b93acfd307 service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c95356a0-d558-48de-a490-97555ce7e3fc req-a77c1d47-5d30-4a6e-865d-d3b93acfd307 service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c95356a0-d558-48de-a490-97555ce7e3fc req-a77c1d47-5d30-4a6e-865d-d3b93acfd307 service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-c95356a0-d558-48de-a490-97555ce7e3fc req-a77c1d47-5d30-4a6e-865d-d3b93acfd307 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-unplugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-c95356a0-d558-48de-a490-97555ce7e3fc req-a77c1d47-5d30-4a6e-865d-d3b93acfd307 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-unplugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Instance destroyed successfully.
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'resources' on Instance uuid e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1461824633',display_name='tempest-ServerRescueNegativeTestJSON-server-1461824633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1461824633',id=4,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-mqt5vmwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:00:12Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=e88c0cbb-b2f5-4e81-817d-9dcc23b1c827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "b69a082e-0149-47b1-beef-e2a3b1351c73", "address": "fa:16:3e:86:39:e7", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69a082e-01", "ovs_interfaceid": "b69a082e-0149-47b1-beef-e2a3b1351c73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG os_vif [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb69a082e-01, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:27 user nova-compute[70594]: INFO os_vif [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:39:e7,bridge_name='br-int',has_traffic_filtering=True,id=b69a082e-0149-47b1-beef-e2a3b1351c73,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69a082e-01')
Jul 26 17:14:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Deleting instance files /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827_del
Jul 26 17:14:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Deletion of /opt/stack/data/nova/instances/e88c0cbb-b2f5-4e81-817d-9dcc23b1c827_del complete
Jul 26 17:14:28 user nova-compute[70594]: INFO nova.compute.manager [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 26 17:14:28 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:14:28 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:14:28 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-5bfe16c9-9039-4011-9d2b-5f3ad03288d9 req-78f61987-ca29-4945-ad58-719e5bb5d676 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5bfe16c9-9039-4011-9d2b-5f3ad03288d9 req-78f61987-ca29-4945-ad58-719e5bb5d676 service nova] Acquiring lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5bfe16c9-9039-4011-9d2b-5f3ad03288d9 req-78f61987-ca29-4945-ad58-719e5bb5d676 service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5bfe16c9-9039-4011-9d2b-5f3ad03288d9 req-78f61987-ca29-4945-ad58-719e5bb5d676 service nova] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-5bfe16c9-9039-4011-9d2b-5f3ad03288d9 req-78f61987-ca29-4945-ad58-719e5bb5d676 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] No waiting events found dispatching network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:29 user nova-compute[70594]: WARNING nova.compute.manager [req-5bfe16c9-9039-4011-9d2b-5f3ad03288d9 req-78f61987-ca29-4945-ad58-719e5bb5d676 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received unexpected event network-vif-plugged-b69a082e-0149-47b1-beef-e2a3b1351c73 for instance with vm_state rescued and task_state deleting.
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:29 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Took 1.43 seconds to deallocate network for instance.
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-a6277c76-67a1-48fa-a279-243f2e831e24 req-494f4cc3-d1db-4c01-a81f-0ae91c6b8bb6 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Received event network-vif-deleted-b69a082e-0149-47b1-beef-e2a3b1351c73 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:29 user nova-compute[70594]: INFO nova.compute.manager [req-a6277c76-67a1-48fa-a279-243f2e831e24 req-494f4cc3-d1db-4c01-a81f-0ae91c6b8bb6 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Neutron deleted interface b69a082e-0149-47b1-beef-e2a3b1351c73; detaching it from the instance and deleting it from the info cache
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.network.neutron [req-a6277c76-67a1-48fa-a279-243f2e831e24 req-494f4cc3-d1db-4c01-a81f-0ae91c6b8bb6 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-a6277c76-67a1-48fa-a279-243f2e831e24 req-494f4cc3-d1db-4c01-a81f-0ae91c6b8bb6 service nova] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Detach interface failed, port_id=b69a082e-0149-47b1-beef-e2a3b1351c73, reason: Instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:14:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:30 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Deleted allocations for instance e88c0cbb-b2f5-4e81-817d-9dcc23b1c827
Jul 26 17:14:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-209efd13-6c46-4ea4-95f0-9ca964cbd951 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "e88c0cbb-b2f5-4e81-817d-9dcc23b1c827" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.097s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquired lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:30 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:14:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'info_cache' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Releasing lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance destroyed successfully.
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'resources' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG os_vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef9e468-62, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:31 user nova-compute[70594]: INFO os_vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62')
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start _get_guest_xml network_info=[{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'numa_topology' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:31 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:31 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'pci_devices' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:14:31 user nova-compute[70594]:   <uuid>35205a75-e9a7-49a5-96f8-57631680ca05</uuid>
Jul 26 17:14:31 user nova-compute[70594]:   <name>instance-00000019</name>
Jul 26 17:14:31 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:14:31 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:14:31 user nova-compute[70594]:   <metadata>
Jul 26 17:14:31 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:14:31 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:14:31 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeTestJSON-server-1367667271</nova:name>
Jul 26 17:14:31 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:14:31</nova:creationTime>
Jul 26 17:14:31 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:14:31 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:14:31 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:14:31 user nova-compute[70594]:       <nova:owner>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:user uuid="5c300fdc9bda48b1afdd00fbc5a6245e">tempest-AttachVolumeTestJSON-35291756-project-member</nova:user>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:project uuid="0459f7d07ec54e3bbfe3915b2b7cfd7b">tempest-AttachVolumeTestJSON-35291756</nova:project>
Jul 26 17:14:31 user nova-compute[70594]:       </nova:owner>
Jul 26 17:14:31 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:14:31 user nova-compute[70594]:       <nova:ports>
Jul 26 17:14:31 user nova-compute[70594]:         <nova:port uuid="5ef9e468-621a-440e-8561-ab66e60d5b8b">
Jul 26 17:14:31 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:14:31 user nova-compute[70594]:         </nova:port>
Jul 26 17:14:31 user nova-compute[70594]:       </nova:ports>
Jul 26 17:14:31 user nova-compute[70594]:     </nova:instance>
Jul 26 17:14:31 user nova-compute[70594]:   </metadata>
Jul 26 17:14:31 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:14:31 user nova-compute[70594]:     <system>
Jul 26 17:14:31 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:14:31 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:14:31 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:14:31 user nova-compute[70594]:       <entry name="serial">35205a75-e9a7-49a5-96f8-57631680ca05</entry>
Jul 26 17:14:31 user nova-compute[70594]:       <entry name="uuid">35205a75-e9a7-49a5-96f8-57631680ca05</entry>
Jul 26 17:14:31 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:14:31 user nova-compute[70594]:     </system>
Jul 26 17:14:31 user nova-compute[70594]:   </sysinfo>
Jul 26 17:14:31 user nova-compute[70594]:   <os>
Jul 26 17:14:31 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:14:31 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:14:31 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:14:31 user nova-compute[70594]:   </os>
Jul 26 17:14:31 user nova-compute[70594]:   <features>
Jul 26 17:14:31 user nova-compute[70594]:     <acpi/>
Jul 26 17:14:31 user nova-compute[70594]:     <apic/>
Jul 26 17:14:31 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:14:31 user nova-compute[70594]:   </features>
Jul 26 17:14:31 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:14:31 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:14:31 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:14:31 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:14:31 user nova-compute[70594]:   </clock>
Jul 26 17:14:31 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:14:31 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:14:31 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:14:31 user nova-compute[70594]:   </cpu>
Jul 26 17:14:31 user nova-compute[70594]:   <devices>
Jul 26 17:14:31 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:14:31 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:14:31 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk"/>
Jul 26 17:14:31 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:14:31 user nova-compute[70594]:     </disk>
Jul 26 17:14:31 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:14:31 user nova-compute[70594]:       <mac address="fa:16:3e:36:f4:ab"/>
Jul 26 17:14:31 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:31 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:14:31 user nova-compute[70594]:       <target dev="tap5ef9e468-62"/>
Jul 26 17:14:31 user nova-compute[70594]:     </interface>
Jul 26 17:14:31 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:14:31 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/console.log" append="off"/>
Jul 26 17:14:31 user nova-compute[70594]:     </serial>
Jul 26 17:14:31 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:14:31 user nova-compute[70594]:     <video>
Jul 26 17:14:31 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:31 user nova-compute[70594]:     </video>
Jul 26 17:14:31 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:14:31 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:14:31 user nova-compute[70594]:     </rng>
Jul 26 17:14:31 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:14:31 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:14:31 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:14:31 user nova-compute[70594]:     </memballoon>
Jul 26 17:14:31 user nova-compute[70594]:   </devices>
Jul 26 17:14:31 user nova-compute[70594]: </domain>
Jul 26 17:14:31 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.180s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Cannot resize image /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'migration_context' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG os_vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef9e468-62, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ef9e468-62, col_values=(('external_ids', {'iface-id': '5ef9e468-621a-440e-8561-ab66e60d5b8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f4:ab', 'vm-uuid': '35205a75-e9a7-49a5-96f8-57631680ca05'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:32 user nova-compute[70594]: INFO os_vif [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62')
Jul 26 17:14:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-aebb0819-b97d-4324-8e3d-afceeda23e90 req-75d1990b-534a-41fd-95fa-4dcc35168152 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-aebb0819-b97d-4324-8e3d-afceeda23e90 req-75d1990b-534a-41fd-95fa-4dcc35168152 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-aebb0819-b97d-4324-8e3d-afceeda23e90 req-75d1990b-534a-41fd-95fa-4dcc35168152 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-aebb0819-b97d-4324-8e3d-afceeda23e90 req-75d1990b-534a-41fd-95fa-4dcc35168152 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG nova.compute.manager [req-aebb0819-b97d-4324-8e3d-afceeda23e90 req-75d1990b-534a-41fd-95fa-4dcc35168152 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:34 user nova-compute[70594]: WARNING nova.compute.manager [req-aebb0819-b97d-4324-8e3d-afceeda23e90 req-75d1990b-534a-41fd-95fa-4dcc35168152 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state stopped and task_state powering-on.
Jul 26 17:14:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391676.2956994, 35205a75-e9a7-49a5-96f8-57631680ca05 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:36 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Resumed (Lifecycle Event)
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:14:36 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance rebooted successfully.
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f1b7497f-329d-415b-b3b8-28edc00ff3c5 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:36 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391676.297188, 35205a75-e9a7-49a5-96f8-57631680ca05 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:36 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Started (Lifecycle Event)
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-c6fc598b-af65-4b39-9165-90cc575a539a req-7cae8b3c-67a5-429c-b75c-fc6190e98f16 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c6fc598b-af65-4b39-9165-90cc575a539a req-7cae8b3c-67a5-429c-b75c-fc6190e98f16 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c6fc598b-af65-4b39-9165-90cc575a539a req-7cae8b3c-67a5-429c-b75c-fc6190e98f16 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c6fc598b-af65-4b39-9165-90cc575a539a req-7cae8b3c-67a5-429c-b75c-fc6190e98f16 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-c6fc598b-af65-4b39-9165-90cc575a539a req-7cae8b3c-67a5-429c-b75c-fc6190e98f16 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:36 user nova-compute[70594]: WARNING nova.compute.manager [req-c6fc598b-af65-4b39-9165-90cc575a539a req-7cae8b3c-67a5-429c-b75c-fc6190e98f16 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state active and task_state None.
Jul 26 17:14:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:42 user nova-compute[70594]: INFO nova.compute.manager [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attaching volume 09acb025-7403-4899-9cac-1775a98fcaea to /dev/vdb
Jul 26 17:14:42 user nova-compute[70594]: DEBUG os_brick.utils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a627d1-deec-4123-bcb9-ed5670ee168a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38545e97-9f3e-4283-9b3f-2c02c39fc1c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae48692-2b2e-467d-b1a8-d15147c6b2a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[363f6d0c-1b71-43fe-be80-f40872b0d9ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:14:42 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:14:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21fc194-7994-451c-a0c7-5acfd5222f8b]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG os_brick.utils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating existing volume attachment record: b932e722-ac2c-4512-b6d7-2221bf7eb55f {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:14:42 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391667.9129884, e88c0cbb-b2f5-4e81-817d-9dcc23b1c827 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:42 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] VM Stopped (Lifecycle Event)
Jul 26 17:14:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-0a264b80-7d0c-42e4-9bf1-5f1451f26860 None None] [instance: e88c0cbb-b2f5-4e81-817d-9dcc23b1c827] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:14:43 user nova-compute[70594]: INFO nova.compute.claims [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Claim successful on node user
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:14:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:14:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Creating image(s)
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "/opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "/opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.policy [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b7e2843bba8470eb36bd37c721c7972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef56c4a969bf4c7ea298d511ccda8490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk 1073741824" returned: 0 in 0.054s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Cannot resize image /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'migration_context' on Instance uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Ensure instance console log exists: /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:44 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Successfully created port: 1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Successfully updated port: 1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquired lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-changed-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Refreshing instance network info cache due to event network-changed-1f0c63c5-83d2-4858-aa77-1aabc9be4abd. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] Acquiring lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updating instance_info_cache with network_info: [{"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Releasing lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Instance network_info: |[{"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] Acquired lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Refreshing network info cache for port 1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Start _get_guest_xml network_info=[{"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:14:46 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:46 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-503206210',display_name='tempest-TestStampPattern-server-503206210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-503206210',id=36,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuU9vkRiUUY91H5G4dksku7YGxgAoLoORaB/v72MwRrgyh8Fg/Vdg35Djak3dez1Rc5MS6C6T9oWoKIMJP3KiX73yatqrHOUDzXbKpDFoqQWisLjqlFn8Tb0pNMuGOcTA==',key_name='tempest-TestStampPattern-1443624212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef56c4a969bf4c7ea298d511ccda8490',ramdisk_id='',reservation_id='r-hmnr3yc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1856485652',owner_user_name='tempest-TestStampPattern-1856485652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:14:44Z,user_data=None,user_id='1b7e2843bba8470eb36bd37c721c7972',uuid=e3deb93d-2ad8-45fa-91f1-68d48dea5637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converting VIF {"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'pci_devices' on Instance uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:14:46 user nova-compute[70594]:   <uuid>e3deb93d-2ad8-45fa-91f1-68d48dea5637</uuid>
Jul 26 17:14:46 user nova-compute[70594]:   <name>instance-00000024</name>
Jul 26 17:14:46 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:14:46 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:14:46 user nova-compute[70594]:   <metadata>
Jul 26 17:14:46 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:14:46 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:14:46 user nova-compute[70594]:       <nova:name>tempest-TestStampPattern-server-503206210</nova:name>
Jul 26 17:14:46 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:14:46</nova:creationTime>
Jul 26 17:14:46 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:14:46 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:14:46 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:14:46 user nova-compute[70594]:       <nova:owner>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:user uuid="1b7e2843bba8470eb36bd37c721c7972">tempest-TestStampPattern-1856485652-project-member</nova:user>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:project uuid="ef56c4a969bf4c7ea298d511ccda8490">tempest-TestStampPattern-1856485652</nova:project>
Jul 26 17:14:46 user nova-compute[70594]:       </nova:owner>
Jul 26 17:14:46 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:14:46 user nova-compute[70594]:       <nova:ports>
Jul 26 17:14:46 user nova-compute[70594]:         <nova:port uuid="1f0c63c5-83d2-4858-aa77-1aabc9be4abd">
Jul 26 17:14:46 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 26 17:14:46 user nova-compute[70594]:         </nova:port>
Jul 26 17:14:46 user nova-compute[70594]:       </nova:ports>
Jul 26 17:14:46 user nova-compute[70594]:     </nova:instance>
Jul 26 17:14:46 user nova-compute[70594]:   </metadata>
Jul 26 17:14:46 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:14:46 user nova-compute[70594]:     <system>
Jul 26 17:14:46 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:14:46 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:14:46 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:14:46 user nova-compute[70594]:       <entry name="serial">e3deb93d-2ad8-45fa-91f1-68d48dea5637</entry>
Jul 26 17:14:46 user nova-compute[70594]:       <entry name="uuid">e3deb93d-2ad8-45fa-91f1-68d48dea5637</entry>
Jul 26 17:14:46 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:14:46 user nova-compute[70594]:     </system>
Jul 26 17:14:46 user nova-compute[70594]:   </sysinfo>
Jul 26 17:14:46 user nova-compute[70594]:   <os>
Jul 26 17:14:46 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:14:46 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:14:46 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:14:46 user nova-compute[70594]:   </os>
Jul 26 17:14:46 user nova-compute[70594]:   <features>
Jul 26 17:14:46 user nova-compute[70594]:     <acpi/>
Jul 26 17:14:46 user nova-compute[70594]:     <apic/>
Jul 26 17:14:46 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:14:46 user nova-compute[70594]:   </features>
Jul 26 17:14:46 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:14:46 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:14:46 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:14:46 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:14:46 user nova-compute[70594]:   </clock>
Jul 26 17:14:46 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:14:46 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:14:46 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:14:46 user nova-compute[70594]:   </cpu>
Jul 26 17:14:46 user nova-compute[70594]:   <devices>
Jul 26 17:14:46 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:14:46 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:14:46 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk"/>
Jul 26 17:14:46 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:14:46 user nova-compute[70594]:     </disk>
Jul 26 17:14:46 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:14:46 user nova-compute[70594]:       <mac address="fa:16:3e:90:62:79"/>
Jul 26 17:14:46 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:46 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:14:46 user nova-compute[70594]:       <target dev="tap1f0c63c5-83"/>
Jul 26 17:14:46 user nova-compute[70594]:     </interface>
Jul 26 17:14:46 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:14:46 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/console.log" append="off"/>
Jul 26 17:14:46 user nova-compute[70594]:     </serial>
Jul 26 17:14:46 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:14:46 user nova-compute[70594]:     <video>
Jul 26 17:14:46 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:46 user nova-compute[70594]:     </video>
Jul 26 17:14:46 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:14:46 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:14:46 user nova-compute[70594]:     </rng>
Jul 26 17:14:46 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:14:46 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:14:46 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:14:46 user nova-compute[70594]:     </memballoon>
Jul 26 17:14:46 user nova-compute[70594]:   </devices>
Jul 26 17:14:46 user nova-compute[70594]: </domain>
Jul 26 17:14:46 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-503206210',display_name='tempest-TestStampPattern-server-503206210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-503206210',id=36,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuU9vkRiUUY91H5G4dksku7YGxgAoLoORaB/v72MwRrgyh8Fg/Vdg35Djak3dez1Rc5MS6C6T9oWoKIMJP3KiX73yatqrHOUDzXbKpDFoqQWisLjqlFn8Tb0pNMuGOcTA==',key_name='tempest-TestStampPattern-1443624212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef56c4a969bf4c7ea298d511ccda8490',ramdisk_id='',reservation_id='r-hmnr3yc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1856485652',owner_user_name='tempest-TestStampPattern-1856485652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:14:44Z,user_data=None,user_id='1b7e2843bba8470eb36bd37c721c7972',uuid=e3deb93d-2ad8-45fa-91f1-68d48dea5637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converting VIF {"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG os_vif [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f0c63c5-83, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f0c63c5-83, col_values=(('external_ids', {'iface-id': '1f0c63c5-83d2-4858-aa77-1aabc9be4abd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:62:79', 'vm-uuid': 'e3deb93d-2ad8-45fa-91f1-68d48dea5637'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:46 user nova-compute[70594]: INFO os_vif [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83')
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No VIF found with MAC fa:16:3e:90:62:79, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updated VIF entry in instance network info cache for port 1f0c63c5-83d2-4858-aa77-1aabc9be4abd. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updating instance_info_cache with network_info: [{"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9d592b95-c1d8-458a-82e6-d6ee8425e647 req-e0438ffe-fc56-4509-b05e-21a6bf080000 service nova] Releasing lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:14:47 user nova-compute[70594]: INFO nova.compute.claims [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Claim successful on node user
Jul 26 17:14:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-4ae098fa-bb0e-4ad5-b94b-ed1f2fa24d4b req-e48363c8-9692-42d3-8e7c-70448919ea10 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4ae098fa-bb0e-4ad5-b94b-ed1f2fa24d4b req-e48363c8-9692-42d3-8e7c-70448919ea10 service nova] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4ae098fa-bb0e-4ad5-b94b-ed1f2fa24d4b req-e48363c8-9692-42d3-8e7c-70448919ea10 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4ae098fa-bb0e-4ad5-b94b-ed1f2fa24d4b req-e48363c8-9692-42d3-8e7c-70448919ea10 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-4ae098fa-bb0e-4ad5-b94b-ed1f2fa24d4b req-e48363c8-9692-42d3-8e7c-70448919ea10 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] No waiting events found dispatching network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:48 user nova-compute[70594]: WARNING nova.compute.manager [req-4ae098fa-bb0e-4ad5-b94b-ed1f2fa24d4b req-e48363c8-9692-42d3-8e7c-70448919ea10 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received unexpected event network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd for instance with vm_state building and task_state spawning.
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:14:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:14:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Creating image(s)
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.policy [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7389a1c933cc4c24b20281842b82e83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b689bf7a7c5049dbac0edae98843930c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.165s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk 1073741824" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:14:48 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Cannot resize image /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG nova.objects.instance [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'migration_context' on Instance uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Ensure instance console log exists: /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:49 user nova-compute[70594]: DEBUG nova.network.neutron [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Successfully created port: 27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-13d37fe1-9901-419a-a133-44031c953479 req-372d8a33-71b4-4b5a-a75e-0773ea0b2cb3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-13d37fe1-9901-419a-a133-44031c953479 req-372d8a33-71b4-4b5a-a75e-0773ea0b2cb3 service nova] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-13d37fe1-9901-419a-a133-44031c953479 req-372d8a33-71b4-4b5a-a75e-0773ea0b2cb3 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-13d37fe1-9901-419a-a133-44031c953479 req-372d8a33-71b4-4b5a-a75e-0773ea0b2cb3 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-13d37fe1-9901-419a-a133-44031c953479 req-372d8a33-71b4-4b5a-a75e-0773ea0b2cb3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] No waiting events found dispatching network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:50 user nova-compute[70594]: WARNING nova.compute.manager [req-13d37fe1-9901-419a-a133-44031c953479 req-372d8a33-71b4-4b5a-a75e-0773ea0b2cb3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received unexpected event network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd for instance with vm_state building and task_state spawning.
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Successfully updated port: 27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391690.2984385, e3deb93d-2ad8-45fa-91f1-68d48dea5637 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] VM Resumed (Lifecycle Event)
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquired lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Instance spawned successfully.
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391690.3004386, e3deb93d-2ad8-45fa-91f1-68d48dea5637 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] VM Started (Lifecycle Event)
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Took 6.48 seconds to spawn the instance on the hypervisor.
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Took 7.36 seconds to build instance.
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2c12dcad-4a82-49b3-a8d5-72f11d7741a7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.460s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:50 user nova-compute[70594]: INFO nova.compute.manager [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Rescuing
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdyhvfsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:50 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cd410e-9e11-4aee-ac6e-d44e9be30e99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:14:50 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff00a53-4352-481e-a454-74e5bc719548]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea] added
Jul 26 17:14:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7346170b-8c74-47a9-8ac7-f4e8e313a27e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78970a7-11b9-4b1e-8bb5-aea2e462003e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdyhvfsH {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdyhvfsH" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7caa48-6ce2-41f5-93a4-59c9c589bf67]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdyhvfsH'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[25154aad-8a20-41cf-98a2-bca5fafedc3b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7371c687-d1d2-4ade-93d4-4a2041d1ad3d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c5f99-e185-4f23-a149-bd1ac5bfda88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260]
Jul 26 17:14:50 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260] successful.
Jul 26 17:14:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f117d0-df02-4c39-a413-6a862e568de4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ba9aa-afc4-462e-8cb1-a897ab371e3b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)
Jul 26 17:14:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:50 user nova-compute[70594]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)
Jul 26 17:14:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b067143-b77e-44cf-a5d5-3730bd1c943d]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:14:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdyhvfsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updating instance_info_cache with network_info: [{"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Releasing lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Instance network_info: |[{"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Start _get_guest_xml network_info=[{"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:14:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-733384455',display_name='tempest-AttachVolumeNegativeTest-server-733384455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-733384455',id=37,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpXMATF8qQoXObgWZFyinXUjpYhCvt9XX6eJBPnSKoYo8Ubq9pt4404qYv7FmEXu8tVnPTuZfzBXN+bqGA8DWku3zeZPFqW+Yd9j58iaUL2Q7+23SEIxS2dm5Gyn3r8BQ==',key_name='tempest-keypair-1822468122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-4xaj0x7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:14:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=ea2e99b6-1db2-4669-9f88-17ddfebe3461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'pci_devices' on Instance uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:14:51 user nova-compute[70594]:   <uuid>ea2e99b6-1db2-4669-9f88-17ddfebe3461</uuid>
Jul 26 17:14:51 user nova-compute[70594]:   <name>instance-00000025</name>
Jul 26 17:14:51 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:14:51 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:14:51 user nova-compute[70594]:   <metadata>
Jul 26 17:14:51 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:14:51 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:14:51 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeNegativeTest-server-733384455</nova:name>
Jul 26 17:14:51 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:14:51</nova:creationTime>
Jul 26 17:14:51 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:14:51 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:14:51 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:14:51 user nova-compute[70594]:       <nova:owner>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:user uuid="7389a1c933cc4c24b20281842b82e83b">tempest-AttachVolumeNegativeTest-1151062115-project-member</nova:user>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:project uuid="b689bf7a7c5049dbac0edae98843930c">tempest-AttachVolumeNegativeTest-1151062115</nova:project>
Jul 26 17:14:51 user nova-compute[70594]:       </nova:owner>
Jul 26 17:14:51 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:14:51 user nova-compute[70594]:       <nova:ports>
Jul 26 17:14:51 user nova-compute[70594]:         <nova:port uuid="27b3ca80-e74a-479a-8846-e3bdc8a2bd33">
Jul 26 17:14:51 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 26 17:14:51 user nova-compute[70594]:         </nova:port>
Jul 26 17:14:51 user nova-compute[70594]:       </nova:ports>
Jul 26 17:14:51 user nova-compute[70594]:     </nova:instance>
Jul 26 17:14:51 user nova-compute[70594]:   </metadata>
Jul 26 17:14:51 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:14:51 user nova-compute[70594]:     <system>
Jul 26 17:14:51 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:14:51 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:14:51 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:14:51 user nova-compute[70594]:       <entry name="serial">ea2e99b6-1db2-4669-9f88-17ddfebe3461</entry>
Jul 26 17:14:51 user nova-compute[70594]:       <entry name="uuid">ea2e99b6-1db2-4669-9f88-17ddfebe3461</entry>
Jul 26 17:14:51 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:14:51 user nova-compute[70594]:     </system>
Jul 26 17:14:51 user nova-compute[70594]:   </sysinfo>
Jul 26 17:14:51 user nova-compute[70594]:   <os>
Jul 26 17:14:51 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:14:51 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:14:51 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:14:51 user nova-compute[70594]:   </os>
Jul 26 17:14:51 user nova-compute[70594]:   <features>
Jul 26 17:14:51 user nova-compute[70594]:     <acpi/>
Jul 26 17:14:51 user nova-compute[70594]:     <apic/>
Jul 26 17:14:51 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:14:51 user nova-compute[70594]:   </features>
Jul 26 17:14:51 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:14:51 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:14:51 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:14:51 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:14:51 user nova-compute[70594]:   </clock>
Jul 26 17:14:51 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:14:51 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:14:51 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:14:51 user nova-compute[70594]:   </cpu>
Jul 26 17:14:51 user nova-compute[70594]:   <devices>
Jul 26 17:14:51 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:14:51 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:14:51 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk"/>
Jul 26 17:14:51 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:14:51 user nova-compute[70594]:     </disk>
Jul 26 17:14:51 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:14:51 user nova-compute[70594]:       <mac address="fa:16:3e:84:2c:5b"/>
Jul 26 17:14:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:51 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:14:51 user nova-compute[70594]:       <target dev="tap27b3ca80-e7"/>
Jul 26 17:14:51 user nova-compute[70594]:     </interface>
Jul 26 17:14:51 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:14:51 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/console.log" append="off"/>
Jul 26 17:14:51 user nova-compute[70594]:     </serial>
Jul 26 17:14:51 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:14:51 user nova-compute[70594]:     <video>
Jul 26 17:14:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:51 user nova-compute[70594]:     </video>
Jul 26 17:14:51 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:14:51 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:14:51 user nova-compute[70594]:     </rng>
Jul 26 17:14:51 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:14:51 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:14:51 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:14:51 user nova-compute[70594]:     </memballoon>
Jul 26 17:14:51 user nova-compute[70594]:   </devices>
Jul 26 17:14:51 user nova-compute[70594]: </domain>
Jul 26 17:14:51 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-733384455',display_name='tempest-AttachVolumeNegativeTest-server-733384455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-733384455',id=37,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpXMATF8qQoXObgWZFyinXUjpYhCvt9XX6eJBPnSKoYo8Ubq9pt4404qYv7FmEXu8tVnPTuZfzBXN+bqGA8DWku3zeZPFqW+Yd9j58iaUL2Q7+23SEIxS2dm5Gyn3r8BQ==',key_name='tempest-keypair-1822468122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-4xaj0x7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:14:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=ea2e99b6-1db2-4669-9f88-17ddfebe3461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG os_vif [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b3ca80-e7, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27b3ca80-e7, col_values=(('external_ids', {'iface-id': '27b3ca80-e74a-479a-8846-e3bdc8a2bd33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:2c:5b', 'vm-uuid': 'ea2e99b6-1db2-4669-9f88-17ddfebe3461'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:51 user nova-compute[70594]: INFO os_vif [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7')
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating instance_info_cache with network_info: [{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:84:2c:5b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:14:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26138323766383831', 'path': '/dev/sdf'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138323766383831', 'path': '/dev/sdf'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.objects.instance [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:14:52 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:14:52 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:14:52 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:14:52 user nova-compute[70594]:   <serial>09acb025-7403-4899-9cac-1775a98fcaea</serial>
Jul 26 17:14:52 user nova-compute[70594]: </disk>
Jul 26 17:14:52 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-changed-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Refreshing instance network info cache due to event network-changed-27b3ca80-e74a-479a-8846-e3bdc8a2bd33. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] Acquiring lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] Acquired lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Refreshing network info cache for port 27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-124761b2-95cd-4e87-9d17-f1782cc57c55 req-06141bc2-43ca-47d4-8240-a1044829c027 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-124761b2-95cd-4e87-9d17-f1782cc57c55 req-06141bc2-43ca-47d4-8240-a1044829c027 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-124761b2-95cd-4e87-9d17-f1782cc57c55 req-06141bc2-43ca-47d4-8240-a1044829c027 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-124761b2-95cd-4e87-9d17-f1782cc57c55 req-06141bc2-43ca-47d4-8240-a1044829c027 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-124761b2-95cd-4e87-9d17-f1782cc57c55 req-06141bc2-43ca-47d4-8240-a1044829c027 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:52 user nova-compute[70594]: WARNING nova.compute.manager [req-124761b2-95cd-4e87-9d17-f1782cc57c55 req-06141bc2-43ca-47d4-8240-a1044829c027 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updated VIF entry in instance network info cache for port 27b3ca80-e74a-479a-8846-e3bdc8a2bd33. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updating instance_info_cache with network_info: [{"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a440b39f-826d-41ae-afbf-5fe4074b7419 req-57a0ed82-a02b-42b3-8aea-0091daf94e24 service nova] Releasing lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance destroyed successfully.
Jul 26 17:14:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Attempting a stable device rescue
Jul 26 17:14:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70594) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:14:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Creating image(s)
Jul 26 17:14:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "/opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "dfe4330598f404d37efca8a949f3836082f99a57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "dfe4330598f404d37efca8a949f3836082f99a57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] No VIF found with MAC fa:16:3e:b1:73:53, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-407b41b1-3ed3-4807-aff4-e39e19e42433 req-fd3ceab0-12e5-446b-a85e-f5ca5e611077 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-407b41b1-3ed3-4807-aff4-e39e19e42433 req-fd3ceab0-12e5-446b-a85e-f5ca5e611077 service nova] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-407b41b1-3ed3-4807-aff4-e39e19e42433 req-fd3ceab0-12e5-446b-a85e-f5ca5e611077 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-407b41b1-3ed3-4807-aff4-e39e19e42433 req-fd3ceab0-12e5-446b-a85e-f5ca5e611077 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-407b41b1-3ed3-4807-aff4-e39e19e42433 req-fd3ceab0-12e5-446b-a85e-f5ca5e611077 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] No waiting events found dispatching network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:54 user nova-compute[70594]: WARNING nova.compute.manager [req-407b41b1-3ed3-4807-aff4-e39e19e42433 req-fd3ceab0-12e5-446b-a85e-f5ca5e611077 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received unexpected event network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 for instance with vm_state building and task_state spawning.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:54 user nova-compute[70594]: WARNING nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:54 user nova-compute[70594]: WARNING nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:54 user nova-compute[70594]: WARNING nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:54 user nova-compute[70594]: WARNING nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:54 user nova-compute[70594]: WARNING nova.compute.manager [req-15d68c62-d99e-4f5e-b2a3-08705e7f6e84 req-2f1628d2-a820-45ea-a9d2-8a5bee7c0100 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-29a0dcd1-2f34-49ae-834c-6e2153e3e3f5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.308s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid f74ff2a1-d268-4472-a284-462f00a1d251 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "6bd16164-caa5-442a-b55c-f84119c36256" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: INFO nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "f74ff2a1-d268-4472-a284-462f00a1d251" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.part --force-share --output=json" returned: 0 in 0.192s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.virt.images [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] f9345a4e-225d-492e-9f2b-ae2f24f2d07c was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.part /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "6bd16164-caa5-442a-b55c-f84119c36256" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "f74ff2a1-d268-4472-a284-462f00a1d251" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.part /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.converted" returned: 0 in 0.443s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "dfe4330598f404d37efca8a949f3836082f99a57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.105s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "dfe4330598f404d37efca8a949f3836082f99a57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "dfe4330598f404d37efca8a949f3836082f99a57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57 --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57 --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57,backing_fmt=raw /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfe4330598f404d37efca8a949f3836082f99a57,backing_fmt=raw /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue" returned: 0 in 0.056s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "dfe4330598f404d37efca8a949f3836082f99a57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'migration_context' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Start _get_guest_xml network_info=[{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "vif_mac": "fa:16:3e:d0:76:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9345a4e-225d-492e-9f2b-ae2f24f2d07c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aa0cbb71-bab6-4f6a-afa1-24c26c851f9f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba580e59-b834-4cd1-99e8-48693d0ed8af', 'serial': 'ba580e59-b834-4cd1-99e8-48693d0ed8af'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'e426cba3-0567-44bc-ada3-9a2d5c47ce3a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'resources' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'numa_topology' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:55 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:55 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:55 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:55 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:55 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd427c0c-b56f-4f36-b883-3e399141b900]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IvGYnOpH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 26 17:14:55 user nova-compute[70594]: node.name = iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:14:55 user nova-compute[70594]: node.tpgt = -1
Jul 26 17:14:55 user nova-compute[70594]: node.startup = automatic
Jul 26 17:14:55 user nova-compute[70594]: node.leading_login = No
Jul 26 17:14:55 user nova-compute[70594]: iface.iscsi_ifacename = default
Jul 26 17:14:55 user nova-compute[70594]: iface.net_ifacename = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.ipaddress = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.prefix_len = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.hwaddress = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.transport_name = tcp
Jul 26 17:14:55 user nova-compute[70594]: iface.initiatorname = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.vlan_id = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.vlan_priority = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.vlan_state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.iface_num = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.mtu = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.port = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.bootproto = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.subnet_mask = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.gateway = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_alt_client_id_state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_alt_client_id = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_dns = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_learn_iqn = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_req_vendor_id_state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_vendor_id_state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_vendor_id = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.dhcp_slp_da = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.fragmentation = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.gratuitous_arp = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.incoming_forwarding = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.tos_state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.tos = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.ttl = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.delayed_ack = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.tcp_nagle = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.tcp_wsf_state = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.tcp_wsf = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.tcp_timer_scale = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.tcp_timestamp = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.redirect = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.def_task_mgmt_timeout = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.header_digest = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.data_digest = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.immediate_data = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.initial_r2t = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.data_seq_inorder = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.data_pdu_inorder = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.erl = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.max_receive_data_len = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.first_burst_len = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.max_outstanding_r2t = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.max_burst_len = 0
Jul 26 17:14:55 user nova-compute[70594]: iface.chap_auth = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.bidi_chap = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.strict_login_compliance = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.discovery_auth = <empty>
Jul 26 17:14:55 user nova-compute[70594]: iface.discovery_logout = <empty>
Jul 26 17:14:55 user nova-compute[70594]: node.discovery_address = <empty>
Jul 26 17:14:55 user nova-compute[70594]: node.discovery_port = 0
Jul 26 17:14:55 user nova-compute[70594]: node.discovery_type = static
Jul 26 17:14:55 user nova-compute[70594]: node.session.initial_cmdsn = 0
Jul 26 17:14:55 user nova-compute[70594]: node.session.initial_login_retry_max = 8
Jul 26 17:14:55 user nova-compute[70594]: node.session.xmit_thread_priority = -20
Jul 26 17:14:55 user nova-compute[70594]: node.session.cmds_max = 128
Jul 26 17:14:55 user nova-compute[70594]: node.session.queue_depth = 32
Jul 26 17:14:55 user nova-compute[70594]: node.session.nr_sessions = 1
Jul 26 17:14:55 user nova-compute[70594]: node.session.auth.authmethod = CHAP
Jul 26 17:14:55 user nova-compute[70594]: node.session.auth.username = IvGYnOpH
Jul 26 17:14:55 user nova-compute[70594]: node.session.auth.password = ***
Jul 26 17:14:55 user nova-compute[70594]: node.session.auth.username_in = <empty>
Jul 26 17:14:55 user nova-compute[70594]: node.session.auth.password_in = <empty>
Jul 26 17:14:55 user nova-compute[70594]: node.session.auth.chap_algs = MD5
Jul 26 17:14:55 user nova-compute[70594]: node.session.timeo.replacement_timeout = 120
Jul 26 17:14:55 user nova-compute[70594]: node.session.err_timeo.abort_timeout = 15
Jul 26 17:14:55 user nova-compute[70594]: node.session.err_timeo.lu_reset_timeout = 30
Jul 26 17:14:55 user nova-compute[70594]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 26 17:14:55 user nova-compute[70594]: node.session.err_timeo.host_reset_timeout = 60
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.FastAbort = Yes
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.InitialR2T = No
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.ImmediateData = Yes
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.FirstBurstLength = 262144
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.MaxBurstLength = 16776192
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.DefaultTime2Retain = 0
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.DefaultTime2Wait = 2
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.MaxConnections = 1
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 26 17:14:55 user nova-compute[70594]: node.session.iscsi.ERL = 0
Jul 26 17:14:55 user nova-compute[70594]: node.session.scan = manual
Jul 26 17:14:55 user nova-compute[70594]: node.session.reopen_max = 0
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].address = 172.16.0.220
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].port = 3260
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].startup = manual
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].tcp.window_size = 524288
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].tcp.type_of_service = 0
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].timeo.logout_timeout = 15
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].timeo.login_timeout = 15
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].timeo.auth_timeout = 45
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].timeo.noop_out_interval = 5
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].timeo.noop_out_timeout = 5
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].iscsi.HeaderDigest = None
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].iscsi.DataDigest = None
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].iscsi.IFMarker = No
Jul 26 17:14:55 user nova-compute[70594]: node.conn[0].iscsi.OFMarker = No
Jul 26 17:14:55 user nova-compute[70594]: # END RECORD
Jul 26 17:14:55 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a576473-c334-42c6-acb2-713612ff3793]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bebe5a-8003-4aff-a038-2d0b1858a990]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvGYnOpH {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvGYnOpH" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ca692-1c24-496f-9764-dadbd697a956]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IvGYnOpH'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a96611-5f48-40c1-a292-8a6dd94dde7f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae6d55-9c8a-44bb-9863-c6dd6d5412c0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)
Jul 26 17:14:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:56 user nova-compute[70594]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)
Jul 26 17:14:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] HCTL ('34', '0', '0', 0) found on session 38 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[854d4b64-a57f-4f02-a52a-3787db765cde]: (4, ('0 0 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Searching for a device in session 38 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23461326461373738', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461326461373738', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-571158116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-571158116',id=34,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-7dvuw2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:13:20Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=aa0cbb71-bab6-4f6a-afa1-24c26c851f9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "vif_mac": "fa:16:3e:d0:76:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "vif_mac": "fa:16:3e:d0:76:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'pci_devices' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:14:56 user nova-compute[70594]:   <uuid>aa0cbb71-bab6-4f6a-afa1-24c26c851f9f</uuid>
Jul 26 17:14:56 user nova-compute[70594]:   <name>instance-00000022</name>
Jul 26 17:14:56 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:14:56 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:14:56 user nova-compute[70594]:   <metadata>
Jul 26 17:14:56 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:14:56 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:14:56 user nova-compute[70594]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-571158116</nova:name>
Jul 26 17:14:56 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:14:55</nova:creationTime>
Jul 26 17:14:56 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:14:56 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:14:56 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:14:56 user nova-compute[70594]:       <nova:owner>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:user uuid="f6af9ec8d9d644c89ba32c10861afba2">tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member</nova:user>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:project uuid="d253357a8f7b42119a7b91385afa0e8b">tempest-ServerBootFromVolumeStableRescueTest-43751456</nova:project>
Jul 26 17:14:56 user nova-compute[70594]:       </nova:owner>
Jul 26 17:14:56 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:14:56 user nova-compute[70594]:       <nova:ports>
Jul 26 17:14:56 user nova-compute[70594]:         <nova:port uuid="96fad621-8fa0-44df-af0b-0d07cbad2013">
Jul 26 17:14:56 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:14:56 user nova-compute[70594]:         </nova:port>
Jul 26 17:14:56 user nova-compute[70594]:       </nova:ports>
Jul 26 17:14:56 user nova-compute[70594]:     </nova:instance>
Jul 26 17:14:56 user nova-compute[70594]:   </metadata>
Jul 26 17:14:56 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:14:56 user nova-compute[70594]:     <system>
Jul 26 17:14:56 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:14:56 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:14:56 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:14:56 user nova-compute[70594]:       <entry name="serial">aa0cbb71-bab6-4f6a-afa1-24c26c851f9f</entry>
Jul 26 17:14:56 user nova-compute[70594]:       <entry name="uuid">aa0cbb71-bab6-4f6a-afa1-24c26c851f9f</entry>
Jul 26 17:14:56 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:14:56 user nova-compute[70594]:     </system>
Jul 26 17:14:56 user nova-compute[70594]:   </sysinfo>
Jul 26 17:14:56 user nova-compute[70594]:   <os>
Jul 26 17:14:56 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:14:56 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:14:56 user nova-compute[70594]:   </os>
Jul 26 17:14:56 user nova-compute[70594]:   <features>
Jul 26 17:14:56 user nova-compute[70594]:     <acpi/>
Jul 26 17:14:56 user nova-compute[70594]:     <apic/>
Jul 26 17:14:56 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:14:56 user nova-compute[70594]:   </features>
Jul 26 17:14:56 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:14:56 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:14:56 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:14:56 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:14:56 user nova-compute[70594]:   </clock>
Jul 26 17:14:56 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:14:56 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:14:56 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:14:56 user nova-compute[70594]:   </cpu>
Jul 26 17:14:56 user nova-compute[70594]:   <devices>
Jul 26 17:14:56 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:14:56 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:14:56 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 17:14:56 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:14:56 user nova-compute[70594]:       <serial>ba580e59-b834-4cd1-99e8-48693d0ed8af</serial>
Jul 26 17:14:56 user nova-compute[70594]:     </disk>
Jul 26 17:14:56 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:14:56 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:14:56 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue"/>
Jul 26 17:14:56 user nova-compute[70594]:       <target dev="vdb" bus="virtio"/>
Jul 26 17:14:56 user nova-compute[70594]:       <boot order="1"/>
Jul 26 17:14:56 user nova-compute[70594]:     </disk>
Jul 26 17:14:56 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:14:56 user nova-compute[70594]:       <mac address="fa:16:3e:d0:76:ac"/>
Jul 26 17:14:56 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:56 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:14:56 user nova-compute[70594]:       <target dev="tap96fad621-8f"/>
Jul 26 17:14:56 user nova-compute[70594]:     </interface>
Jul 26 17:14:56 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:14:56 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/console.log" append="off"/>
Jul 26 17:14:56 user nova-compute[70594]:     </serial>
Jul 26 17:14:56 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:14:56 user nova-compute[70594]:     <video>
Jul 26 17:14:56 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:14:56 user nova-compute[70594]:     </video>
Jul 26 17:14:56 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:14:56 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:14:56 user nova-compute[70594]:     </rng>
Jul 26 17:14:56 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:14:56 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:14:56 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:14:56 user nova-compute[70594]:     </memballoon>
Jul 26 17:14:56 user nova-compute[70594]:   </devices>
Jul 26 17:14:56 user nova-compute[70594]: </domain>
Jul 26 17:14:56 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-bf7d967e-0a5b-45d2-aec3-0e7cb5c972ae req-e91752bf-2c09-4e9e-9f77-e7cce977a629 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bf7d967e-0a5b-45d2-aec3-0e7cb5c972ae req-e91752bf-2c09-4e9e-9f77-e7cce977a629 service nova] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bf7d967e-0a5b-45d2-aec3-0e7cb5c972ae req-e91752bf-2c09-4e9e-9f77-e7cce977a629 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bf7d967e-0a5b-45d2-aec3-0e7cb5c972ae req-e91752bf-2c09-4e9e-9f77-e7cce977a629 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-bf7d967e-0a5b-45d2-aec3-0e7cb5c972ae req-e91752bf-2c09-4e9e-9f77-e7cce977a629 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] No waiting events found dispatching network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:56 user nova-compute[70594]: WARNING nova.compute.manager [req-bf7d967e-0a5b-45d2-aec3-0e7cb5c972ae req-e91752bf-2c09-4e9e-9f77-e7cce977a629 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received unexpected event network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 for instance with vm_state building and task_state spawning.
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance destroyed successfully.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] No VIF found with MAC fa:16:3e:d0:76:ac, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Detaching volume 09acb025-7403-4899-9cac-1775a98fcaea
Jul 26 17:14:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.virt.block_device [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Attempting to driver detach volume 09acb025-7403-4899-9cac-1775a98fcaea from mountpoint /dev/vdb
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Attempting to detach device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:14:56 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:14:56 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:14:56 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:14:56 user nova-compute[70594]:   <serial>09acb025-7403-4899-9cac-1775a98fcaea</serial>
Jul 26 17:14:56 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:14:56 user nova-compute[70594]: </disk>
Jul 26 17:14:56 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the persistent domain config.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:14:56 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:14:56 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:14:56 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:14:56 user nova-compute[70594]:   <serial>09acb025-7403-4899-9cac-1775a98fcaea</serial>
Jul 26 17:14:56 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:14:56 user nova-compute[70594]: </disk>
Jul 26 17:14:56 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391696.4985108, ea2e99b6-1db2-4669-9f88-17ddfebe3461 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] VM Resumed (Lifecycle Event)
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Instance spawned successfully.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391696.4994693, ea2e99b6-1db2-4669-9f88-17ddfebe3461 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] VM Started (Lifecycle Event)
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Took 8.32 seconds to spawn the instance on the hypervisor.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Took 9.28 seconds to build instance.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-083b3808-fe09-4cac-af35-0818c55da0fa tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.416s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.963s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391696.9196362, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:14:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully detached device vdb from instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d from the live domain config.
Jul 26 17:14:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdyhvfsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:56 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1380bd68-6b9f-4762-8ebd-719c59a0ed22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:14:56 user nova-compute[70594]: No targets found.
Jul 26 17:14:56 user nova-compute[70594]: iSNS:
Jul 26 17:14:56 user nova-compute[70594]: No targets found.
Jul 26 17:14:56 user nova-compute[70594]: STATIC:
Jul 26 17:14:56 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:14:56 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:56 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:56 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:14:56 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:56 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:56 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:14:56 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:56 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:56 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea
Jul 26 17:14:56 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:56 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:56 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186
Jul 26 17:14:56 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:56 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:56 user nova-compute[70594]: FIRMWARE:
Jul 26 17:14:56 user nova-compute[70594]: No targets found.
Jul 26 17:14:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:14:56 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:14:56 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:14:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7933cdfe-5515-442c-a0a4-269b3d59da41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a2e03-2261-4ba7-8033-a85b03e47b65]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)
Jul 26 17:14:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:57 user nova-compute[70594]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea (non-flash)
Jul 26 17:14:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591b2c7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea'): ({'sdf'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Removing single pathed devices sdf {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe89f85b-9e95-4c5e-9deb-2b99dbbd51cc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8558aa-5155-4da4-a60e-09dbadc963d0]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Flushing IO for device /dev/sdf {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6466ac-8c25-4840-b586-fe09288696f7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c0655f-ee17-4b5d-9473-9ce40bedc33d]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c23b07-77ba-4808-8cbd-5e62ab0cdffd]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --logout" returned: 0 in 0.124s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9243b32-fc8f-4370-b521-bc1a8c20c339]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260]
Jul 26 17:14:57 user nova-compute[70594]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea, portal: 172.16.0.220,3260] successful.
Jul 26 17:14:57 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09acb025-7403-4899-9cac-1775a98fcaea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a92c6d-e361-4fc8-be32-25744520c3b0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] <== disconnect_volume: return (434ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing instance network info cache due to event network-changed-8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] Acquiring lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] Acquired lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG nova.network.neutron [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Refreshing network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:57 user nova-compute[70594]: INFO nova.compute.manager [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Terminating instance
Jul 26 17:14:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'flavor' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3a16359a-6ae2-4cfa-8876-9c8f4c8fbcb5 tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.157s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-556255ae-d194-477d-8351-64d6f0f5a883 req-ed706e83-6d0c-4630-9a3b-afb2f864c337 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-556255ae-d194-477d-8351-64d6f0f5a883 req-ed706e83-6d0c-4630-9a3b-afb2f864c337 service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-556255ae-d194-477d-8351-64d6f0f5a883 req-ed706e83-6d0c-4630-9a3b-afb2f864c337 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-556255ae-d194-477d-8351-64d6f0f5a883 req-ed706e83-6d0c-4630-9a3b-afb2f864c337 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-556255ae-d194-477d-8351-64d6f0f5a883 req-ed706e83-6d0c-4630-9a3b-afb2f864c337 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-556255ae-d194-477d-8351-64d6f0f5a883 req-ed706e83-6d0c-4630-9a3b-afb2f864c337 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-unplugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updated VIF entry in instance network info cache for port 8a2bebe0-90e3-4160-a03d-f8548a907a0f. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [{"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9dfbf2b8-e02f-4a4a-99cf-79cf689eeddf req-ed26e5b4-168c-4115-adca-800e446fec74 service nova] Releasing lock "refresh_cache-636d93f0-fdb5-46bc-8835-d35298ad7afb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:14:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Instance destroyed successfully.
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.objects.instance [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lazy-loading 'resources' on Instance uuid 636d93f0-fdb5-46bc-8835-d35298ad7afb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1924341254',display_name='tempest-TestShelveInstance-server-1924341254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1924341254',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD711OgGvL8zsvkRnXwJ85qTyJEzM/jz9LEhghOi0M8kOEyRHFIeZT7VGCqv0lS8aw7Jha3PuCpybuEhuzP6uNrqPTLg7BfaX9h4TOz2kmXmlcqBdO/hTis4D7HMyCA1pw==',key_name='tempest-TestShelveInstance-284998996',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7f2f383f3f49f89a60c1d12e7e0102',ramdisk_id='',reservation_id='r-0ksxqzxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-448703386',owner_user_name='tempest-TestShelveInstance-448703386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:13:23Z,user_data=None,user_id='59ec9b7626b3434ca0a3b14075902993',uuid=636d93f0-fdb5-46bc-8835-d35298ad7afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converting VIF {"id": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "address": "fa:16:3e:7c:1c:93", "network": {"id": "6b66bbd9-0200-4adc-9f40-e2ca31c60395", "bridge": "br-int", "label": "tempest-TestShelveInstance-181435162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7f2f383f3f49f89a60c1d12e7e0102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2bebe0-90", "ovs_interfaceid": "8a2bebe0-90e3-4160-a03d-f8548a907a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_vif [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a2bebe0-90, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:14:58 user nova-compute[70594]: INFO os_vif [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=8a2bebe0-90e3-4160-a03d-f8548a907a0f,network=Network(6b66bbd9-0200-4adc-9f40-e2ca31c60395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2bebe0-90')
Jul 26 17:14:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBQihHp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:14:58 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e64a1f-537e-4bab-848b-7e4ca9379d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:14:58 user nova-compute[70594]: No targets found.
Jul 26 17:14:58 user nova-compute[70594]: iSNS:
Jul 26 17:14:58 user nova-compute[70594]: No targets found.
Jul 26 17:14:58 user nova-compute[70594]: STATIC:
Jul 26 17:14:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:14:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:14:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336
Jul 26 17:14:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:58 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186
Jul 26 17:14:58 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:14:58 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:14:58 user nova-compute[70594]: FIRMWARE:
Jul 26 17:14:58 user nova-compute[70594]: No targets found.
Jul 26 17:14:58 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:14:58 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:14:58 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:14:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f34ca6d-bebd-4978-8b17-219f37981d92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe63a2-f3cf-4662-a721-a7cb4c269ee1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:59 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:59 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:59 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:14:59 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:14:59 user nova-compute[70594]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 (non-flash)
Jul 26 17:14:59 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:14:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5900520280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e0d69-aa63-4d99-a176-76a257557242]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3438bd5-5b29-4627-899b-d3ac01a22a18]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3218ed6-8190-46e3-b097-0fddf870dd6a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d24eb-bcde-4227-a2e0-50a69b288967]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_46f707', '/dev/disk/by-id/scsi-1SCST_BIO46f707-89122364953acf85', '/dev/disk/by-id/scsi-23839313232333634') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0530be3-635a-4061-9e09-2900c507f5cb]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e403d9d-61cb-4874-ae20-bd6f37f56e82]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f953a-8f59-42d8-90b1-c0c71db4bfb9]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260]
Jul 26 17:14:59 user nova-compute[70594]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336, portal: 172.16.0.220,3260] successful.
Jul 26 17:14:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:714be488-518b-47e6-addb-15122230f336 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee5cb3-22cd-4222-be73-10580ece6161]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] <== disconnect_volume: return (419ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:14:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Deleting instance files /opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb_del
Jul 26 17:14:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Deletion of /opt/stack/data/nova/instances/636d93f0-fdb5-46bc-8835-d35298ad7afb_del complete
Jul 26 17:14:59 user nova-compute[70594]: INFO nova.compute.manager [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Took 1.68 seconds to destroy the instance on the hypervisor.
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:59 user nova-compute[70594]: WARNING nova.compute.manager [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:14:59 user nova-compute[70594]: WARNING nova.compute.manager [req-5e495180-a170-4c30-af3a-79ec2700eb27 req-c47621b4-1da3-4572-91c4-1c6ee860b5f2 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state rescuing.
Jul 26 17:14:59 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:00 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Took 0.57 seconds to deallocate network for instance.
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] Acquiring lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] No waiting events found dispatching network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:00 user nova-compute[70594]: WARNING nova.compute.manager [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received unexpected event network-vif-plugged-8a2bebe0-90e3-4160-a03d-f8548a907a0f for instance with vm_state active and task_state deleting.
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-68842658-0289-433d-bf5a-72f67918d8eb req-06c5d955-c62c-4a8f-b805-6f6dbae71800 service nova] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Received event network-vif-deleted-8a2bebe0-90e3-4160-a03d-f8548a907a0f {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for aa0cbb71-bab6-4f6a-afa1-24c26c851f9f due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391700.7958395, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:15:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Resumed (Lifecycle Event)
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ed44ddff-65bf-4d90-bfaf-cdd350300add tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:15:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391700.7976918, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:15:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Started (Lifecycle Event)
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:15:00 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 26 17:15:00 user nova-compute[70594]: INFO nova.compute.manager [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Took 0.96 seconds to detach 1 volumes for instance.
Jul 26 17:15:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Deleting volume: 714be488-518b-47e6-addb-15122230f336 {{(pid=70594) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 26 17:15:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:01 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:15:01 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:15:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:01 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Deleted allocations for instance 636d93f0-fdb5-46bc-8835-d35298ad7afb
Jul 26 17:15:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-53122fd7-692f-4efb-a95c-aeed68bd1d7d tempest-TestShelveInstance-448703386 tempest-TestShelveInstance-448703386-project-member] Lock "636d93f0-fdb5-46bc-8835-d35298ad7afb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.962s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:12 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:12 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391698.815319, 636d93f0-fdb5-46bc-8835-d35298ad7afb => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:15:13 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] VM Stopped (Lifecycle Event)
Jul 26 17:15:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-da48e98c-ccae-4adb-b7b5-84fe4bf85849 None None] [instance: 636d93f0-fdb5-46bc-8835-d35298ad7afb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:16 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:15:16 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7264MB free_disk=25.06124496459961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance f74ff2a1-d268-4472-a284-462f00a1d251 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:15:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:17 user nova-compute[70594]: INFO nova.compute.manager [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Terminating instance
Jul 26 17:15:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-9031e4b3-20c4-4ab1-8f10-b4e195272efe req-fbd44445-46db-48c1-ad35-5e3daf185144 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9031e4b3-20c4-4ab1-8f10-b4e195272efe req-fbd44445-46db-48c1-ad35-5e3daf185144 service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9031e4b3-20c4-4ab1-8f10-b4e195272efe req-fbd44445-46db-48c1-ad35-5e3daf185144 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9031e4b3-20c4-4ab1-8f10-b4e195272efe req-fbd44445-46db-48c1-ad35-5e3daf185144 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-9031e4b3-20c4-4ab1-8f10-b4e195272efe req-fbd44445-46db-48c1-ad35-5e3daf185144 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-9031e4b3-20c4-4ab1-8f10-b4e195272efe req-fbd44445-46db-48c1-ad35-5e3daf185144 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-unplugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:15:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Instance destroyed successfully.
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.objects.instance [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lazy-loading 'resources' on Instance uuid 026577e6-2de3-45b9-adbf-7686e72a8c61 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T16:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135380042',display_name='tempest-ServerRescueNegativeTestJSON-server-135380042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135380042',id=3,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2349e37642f4f4d9a3fe7b2c3d7a6c7',ramdisk_id='',reservation_id='r-el3f5453',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-159727237',owner_user_name='tempest-ServerRescueNegativeTestJSON-159727237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:04:53Z,user_data=None,user_id='f5f5bd39056d4ebc973b6d8571a796ab',uuid=026577e6-2de3-45b9-adbf-7686e72a8c61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converting VIF {"id": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "address": "fa:16:3e:18:95:5f", "network": {"id": "15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1937733731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2349e37642f4f4d9a3fe7b2c3d7a6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba2b845-fb", "ovs_interfaceid": "7ba2b845-fb6d-491b-943c-f6c7470ef865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG os_vif [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ba2b845-fb, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:15:18 user nova-compute[70594]: INFO os_vif [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:95:5f,bridge_name='br-int',has_traffic_filtering=True,id=7ba2b845-fb6d-491b-943c-f6c7470ef865,network=Network(15a0b3f0-ecb4-43d7-9ae3-29dbf08b3d4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba2b845-fb')
Jul 26 17:15:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Deleting instance files /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61_del
Jul 26 17:15:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Deletion of /opt/stack/data/nova/instances/026577e6-2de3-45b9-adbf-7686e72a8c61_del complete
Jul 26 17:15:18 user nova-compute[70594]: INFO nova.compute.manager [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 26 17:15:18 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:15:18 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [{"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-8ef02326-71b1-43ca-a53d-c2f73b049896" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:19 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Took 0.69 seconds to deallocate network for instance.
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-ef45c2dc-59d0-4c9d-916e-ae7f0c10d679 req-6b55815b-d09f-4168-8306-46ffc7470489 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-deleted-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:19 user nova-compute[70594]: INFO nova.compute.manager [req-ef45c2dc-59d0-4c9d-916e-ae7f0c10d679 req-6b55815b-d09f-4168-8306-46ffc7470489 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Neutron deleted interface 7ba2b845-fb6d-491b-943c-f6c7470ef865; detaching it from the instance and deleting it from the info cache
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.network.neutron [req-ef45c2dc-59d0-4c9d-916e-ae7f0c10d679 req-6b55815b-d09f-4168-8306-46ffc7470489 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-ef45c2dc-59d0-4c9d-916e-ae7f0c10d679 req-6b55815b-d09f-4168-8306-46ffc7470489 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Detach interface failed, port_id=7ba2b845-fb6d-491b-943c-f6c7470ef865, reason: Instance 026577e6-2de3-45b9-adbf-7686e72a8c61 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:15:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:19 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Deleted allocations for instance 026577e6-2de3-45b9-adbf-7686e72a8c61
Jul 26 17:15:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-c47c8b68-ed5d-4c3a-a0ee-702441c6cfc1 tempest-ServerRescueNegativeTestJSON-159727237 tempest-ServerRescueNegativeTestJSON-159727237-project-member] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.078s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-2d84efe2-f578-4e95-855d-dd2fea52de15 req-3ac44cc7-e0d6-4bc9-84a5-fe3ac18af032 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2d84efe2-f578-4e95-855d-dd2fea52de15 req-3ac44cc7-e0d6-4bc9-84a5-fe3ac18af032 service nova] Acquiring lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2d84efe2-f578-4e95-855d-dd2fea52de15 req-3ac44cc7-e0d6-4bc9-84a5-fe3ac18af032 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2d84efe2-f578-4e95-855d-dd2fea52de15 req-3ac44cc7-e0d6-4bc9-84a5-fe3ac18af032 service nova] Lock "026577e6-2de3-45b9-adbf-7686e72a8c61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-2d84efe2-f578-4e95-855d-dd2fea52de15 req-3ac44cc7-e0d6-4bc9-84a5-fe3ac18af032 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] No waiting events found dispatching network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:20 user nova-compute[70594]: WARNING nova.compute.manager [req-2d84efe2-f578-4e95-855d-dd2fea52de15 req-3ac44cc7-e0d6-4bc9-84a5-fe3ac18af032 service nova] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Received unexpected event network-vif-plugged-7ba2b845-fb6d-491b-943c-f6c7470ef865 for instance with vm_state deleted and task_state None.
Jul 26 17:15:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:33 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391718.6933634, 026577e6-2de3-45b9-adbf-7686e72a8c61 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:15:33 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] VM Stopped (Lifecycle Event)
Jul 26 17:15:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-61269112-74d7-43c6-91f3-9179b3303872 None None] [instance: 026577e6-2de3-45b9-adbf-7686e72a8c61] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:15:44 user nova-compute[70594]: INFO nova.compute.claims [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Claim successful on node user
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.network.neutron [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:15:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:15:44 user nova-compute[70594]: INFO nova.virt.block_device [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Booting with volume 79a93153-6f28-454c-ac48-813c06647022 at /dev/vda
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.policy [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feffa97fa65d4c2e963c6ef550377550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cf13ef41474309a9651baab74f6903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG os_brick.utils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[845dc85b-6e04-4326-a150-bea236221a6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[193523f0-05ae-4d59-b08a-b08d5d04eb51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d22699-e513-4914-a343-cda606808b99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184f24d-4c26-4a44-96b1-6ceb27fc7cda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:15:44 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:15:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82a1c40-4bfb-4c20-b5c8-ac3a12bee4e6]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG os_brick.utils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:15:44 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating existing volume attachment record: 87291ae4-c47b-4de8-87f1-62644fe60021 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:15:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Successfully created port: 333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Successfully updated port: 333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquired lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-changed-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Refreshing instance network info cache due to event network-changed-333cb45e-2afd-421e-bfbb-99c24655ba0d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] Acquiring lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Releasing lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance network_info: |[{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] Acquired lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:15:46 user nova-compute[70594]: DEBUG nova.network.neutron [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Refreshing network info cache for port 333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:15:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updated VIF entry in instance network info cache for port 333cb45e-2afd-421e-bfbb-99c24655ba0d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:15:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-92bf83ae-c641-4209-bc3b-43293696eb97 req-c874f35d-f99b-4e2a-963e-91b6d6d1eaa7 service nova] Releasing lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:15:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "f74ff2a1-d268-4472-a284-462f00a1d251" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:49 user nova-compute[70594]: INFO nova.compute.manager [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Terminating instance
Jul 26 17:15:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Instance destroyed successfully.
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'resources' on Instance uuid f74ff2a1-d268-4472-a284-462f00a1d251 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-418679531',display_name='tempest-TestVolumeBootPattern-server-418679531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-418679531',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-0m1mplqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:14:18Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=f74ff2a1-d268-4472-a284-462f00a1d251,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "address": "fa:16:3e:f4:d2:54", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d712eb-9a", "ovs_interfaceid": "37d712eb-9a39-48fc-bec5-8d9f42aab275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_vif [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d712eb-9a, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:15:50 user nova-compute[70594]: INFO os_vif [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d2:54,bridge_name='br-int',has_traffic_filtering=True,id=37d712eb-9a39-48fc-bec5-8d9f42aab275,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d712eb-9a')
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzOiKPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:15:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-839d47d9-78bc-46f0-a054-cb40b488820c req-61b629a1-1775-4ffe-8b1f-beabd54b302f service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-vif-unplugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-839d47d9-78bc-46f0-a054-cb40b488820c req-61b629a1-1775-4ffe-8b1f-beabd54b302f service nova] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-839d47d9-78bc-46f0-a054-cb40b488820c req-61b629a1-1775-4ffe-8b1f-beabd54b302f service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-839d47d9-78bc-46f0-a054-cb40b488820c req-61b629a1-1775-4ffe-8b1f-beabd54b302f service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-839d47d9-78bc-46f0-a054-cb40b488820c req-61b629a1-1775-4ffe-8b1f-beabd54b302f service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] No waiting events found dispatching network-vif-unplugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-839d47d9-78bc-46f0-a054-cb40b488820c req-61b629a1-1775-4ffe-8b1f-beabd54b302f service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-vif-unplugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd7d75-96af-4ce1-a6f5-d67ba14e975f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:15:50 user nova-compute[70594]: No targets found.
Jul 26 17:15:50 user nova-compute[70594]: iSNS:
Jul 26 17:15:50 user nova-compute[70594]: No targets found.
Jul 26 17:15:50 user nova-compute[70594]: STATIC:
Jul 26 17:15:50 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:15:50 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:15:50 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:15:50 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:15:50 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:15:50 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:15:50 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186
Jul 26 17:15:50 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:15:50 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:15:50 user nova-compute[70594]: FIRMWARE:
Jul 26 17:15:50 user nova-compute[70594]: No targets found.
Jul 26 17:15:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:15:50 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:15:50 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7431dc-4601-47b5-b660-030a78cb59cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[88927d79-11e5-428b-84a6-c6663a0f2cc1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:15:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:15:50 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:15:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:15:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:15:50 user nova-compute[70594]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 (non-flash)
Jul 26 17:15:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910279990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c4243-a72d-4fec-85ff-08306006165c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b708284b-9d8a-49b8-a2dd-cd14a78d0f3a]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8d9e5c-2a10-400a-9cd7-a9c3262e4fa0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3691755-6051-4277-9229-aec50828f2df]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e99b66e-5a7f-41c7-a555-451d062e0677]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a826fd26-cfb4-4dca-af72-82a8f46dfcde]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260]
Jul 26 17:15:50 user nova-compute[70594]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186, portal: 172.16.0.220,3260] successful.
Jul 26 17:15:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc6529c-c755-4db5-afab-f636799f4186 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a3c16-689f-4a1e-a684-1dc801f32915]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== disconnect_volume: return (347ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:15:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:15:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Deleting instance files /opt/stack/data/nova/instances/f74ff2a1-d268-4472-a284-462f00a1d251_del
Jul 26 17:15:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Deletion of /opt/stack/data/nova/instances/f74ff2a1-d268-4472-a284-462f00a1d251_del complete
Jul 26 17:15:51 user nova-compute[70594]: INFO nova.compute.manager [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 26 17:15:51 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:15:51 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Took 0.82 seconds to deallocate network for instance.
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-7fb0dcfe-baf9-41bb-b419-07f59096ad0a req-91958333-accb-4eb3-8537-1b465d4cff39 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-vif-deleted-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:15:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Creating image(s)
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Ensure instance console log exists: /opt/stack/data/nova/instances/356f54bb-c75c-4e17-8193-65f8a662e572/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Start _get_guest_xml network_info=[{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '356f54bb-c75c-4e17-8193-65f8a662e572', 'attached_at': '', 'detached_at': '', 'volume_id': '79a93153-6f28-454c-ac48-813c06647022', 'serial': '79a93153-6f28-454c-ac48-813c06647022'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '87291ae4-c47b-4de8-87f1-62644fe60021', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:15:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:15:51 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:15:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:15:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:15:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:15:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:15:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:15:51 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:15:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23ec42-7086-4540-a767-7d11a23f29a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:15:52 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0eb4d4-e254-47d6-9ef8-2a23adac38fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022] added
Jul 26 17:15:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c43efd-5aff-4c81-96e8-bdf22719b3ad]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a49de0d-d7e8-4623-8ec2-f2fd7afc2edc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdhCZHLn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdhCZHLn" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc851c-4d71-4608-a9dd-072dd0b90190]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdhCZHLn'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a74f37a-8748-42a0-8eff-74a75e755ab2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85801d0a-d899-4c58-8c31-1ad3f2f57413]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:15:52 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:15:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:15:52 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:15:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[085e94ce-7d7e-404f-83b4-a9eed2fa6675]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]
Jul 26 17:15:52 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.
Jul 26 17:15:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b8343a-19b5-4f00-af1a-d657cb0a17b3]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffb6e2-0f30-41c4-a1f2-f998455dd198]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:15:52 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:15:52 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:15:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:15:52 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:15:52 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:15:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d7291-b154-436b-b67b-d6eeacadfc62]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-6b61f720-d9f5-4187-85ac-1ed9ce16026c req-78883cac-92a0-447b-8376-e743a55001e0 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received event network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6b61f720-d9f5-4187-85ac-1ed9ce16026c req-78883cac-92a0-447b-8376-e743a55001e0 service nova] Acquiring lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6b61f720-d9f5-4187-85ac-1ed9ce16026c req-78883cac-92a0-447b-8376-e743a55001e0 service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6b61f720-d9f5-4187-85ac-1ed9ce16026c req-78883cac-92a0-447b-8376-e743a55001e0 service nova] Lock "f74ff2a1-d268-4472-a284-462f00a1d251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:52 user nova-compute[70594]: DEBUG nova.compute.manager [req-6b61f720-d9f5-4187-85ac-1ed9ce16026c req-78883cac-92a0-447b-8376-e743a55001e0 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] No waiting events found dispatching network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:52 user nova-compute[70594]: WARNING nova.compute.manager [req-6b61f720-d9f5-4187-85ac-1ed9ce16026c req-78883cac-92a0-447b-8376-e743a55001e0 service nova] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Received unexpected event network-vif-plugged-37d712eb-9a39-48fc-bec5-8d9f42aab275 for instance with vm_state active and task_state deleting.
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23935656235323232', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935656235323232', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1398093165',display_name='tempest-ServerActionsTestOtherA-server-1398093165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1398093165',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-f8ds1v5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=356f54bb-c75c-4e17-8193-65f8a662e572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.objects.instance [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'pci_devices' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:15:53 user nova-compute[70594]:   <uuid>356f54bb-c75c-4e17-8193-65f8a662e572</uuid>
Jul 26 17:15:53 user nova-compute[70594]:   <name>instance-00000026</name>
Jul 26 17:15:53 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:15:53 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:15:53 user nova-compute[70594]:   <metadata>
Jul 26 17:15:53 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:15:53 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:15:53 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherA-server-1398093165</nova:name>
Jul 26 17:15:53 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:15:51</nova:creationTime>
Jul 26 17:15:53 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:15:53 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:15:53 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:15:53 user nova-compute[70594]:       <nova:owner>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:user uuid="feffa97fa65d4c2e963c6ef550377550">tempest-ServerActionsTestOtherA-1622849011-project-member</nova:user>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:project uuid="a4cf13ef41474309a9651baab74f6903">tempest-ServerActionsTestOtherA-1622849011</nova:project>
Jul 26 17:15:53 user nova-compute[70594]:       </nova:owner>
Jul 26 17:15:53 user nova-compute[70594]:       <nova:ports>
Jul 26 17:15:53 user nova-compute[70594]:         <nova:port uuid="333cb45e-2afd-421e-bfbb-99c24655ba0d">
Jul 26 17:15:53 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 26 17:15:53 user nova-compute[70594]:         </nova:port>
Jul 26 17:15:53 user nova-compute[70594]:       </nova:ports>
Jul 26 17:15:53 user nova-compute[70594]:     </nova:instance>
Jul 26 17:15:53 user nova-compute[70594]:   </metadata>
Jul 26 17:15:53 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:15:53 user nova-compute[70594]:     <system>
Jul 26 17:15:53 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:15:53 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:15:53 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:15:53 user nova-compute[70594]:       <entry name="serial">356f54bb-c75c-4e17-8193-65f8a662e572</entry>
Jul 26 17:15:53 user nova-compute[70594]:       <entry name="uuid">356f54bb-c75c-4e17-8193-65f8a662e572</entry>
Jul 26 17:15:53 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:15:53 user nova-compute[70594]:     </system>
Jul 26 17:15:53 user nova-compute[70594]:   </sysinfo>
Jul 26 17:15:53 user nova-compute[70594]:   <os>
Jul 26 17:15:53 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:15:53 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:15:53 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:15:53 user nova-compute[70594]:   </os>
Jul 26 17:15:53 user nova-compute[70594]:   <features>
Jul 26 17:15:53 user nova-compute[70594]:     <acpi/>
Jul 26 17:15:53 user nova-compute[70594]:     <apic/>
Jul 26 17:15:53 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:15:53 user nova-compute[70594]:   </features>
Jul 26 17:15:53 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:15:53 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:15:53 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:15:53 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:15:53 user nova-compute[70594]:   </clock>
Jul 26 17:15:53 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:15:53 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:15:53 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:15:53 user nova-compute[70594]:   </cpu>
Jul 26 17:15:53 user nova-compute[70594]:   <devices>
Jul 26 17:15:53 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:15:53 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:15:53 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:15:53 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:15:53 user nova-compute[70594]:       <serial>79a93153-6f28-454c-ac48-813c06647022</serial>
Jul 26 17:15:53 user nova-compute[70594]:     </disk>
Jul 26 17:15:53 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:15:53 user nova-compute[70594]:       <mac address="fa:16:3e:3b:0e:67"/>
Jul 26 17:15:53 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:15:53 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:15:53 user nova-compute[70594]:       <target dev="tap333cb45e-2a"/>
Jul 26 17:15:53 user nova-compute[70594]:     </interface>
Jul 26 17:15:53 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:15:53 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/356f54bb-c75c-4e17-8193-65f8a662e572/console.log" append="off"/>
Jul 26 17:15:53 user nova-compute[70594]:     </serial>
Jul 26 17:15:53 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:15:53 user nova-compute[70594]:     <video>
Jul 26 17:15:53 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:15:53 user nova-compute[70594]:     </video>
Jul 26 17:15:53 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:15:53 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:15:53 user nova-compute[70594]:     </rng>
Jul 26 17:15:53 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:15:53 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:15:53 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:15:53 user nova-compute[70594]:     </memballoon>
Jul 26 17:15:53 user nova-compute[70594]:   </devices>
Jul 26 17:15:53 user nova-compute[70594]: </domain>
Jul 26 17:15:53 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1398093165',display_name='tempest-ServerActionsTestOtherA-server-1398093165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1398093165',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-f8ds1v5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=356f54bb-c75c-4e17-8193-65f8a662e572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG os_vif [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333cb45e-2a, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap333cb45e-2a, col_values=(('external_ids', {'iface-id': '333cb45e-2afd-421e-bfbb-99c24655ba0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:0e:67', 'vm-uuid': '356f54bb-c75c-4e17-8193-65f8a662e572'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:53 user nova-compute[70594]: INFO os_vif [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a')
Jul 26 17:15:53 user nova-compute[70594]: INFO nova.compute.manager [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Took 1.56 seconds to detach 1 volumes for instance.
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Deleting volume: 3dc6529c-c755-4db5-afab-f636799f4186 {{(pid=70594) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No VIF found with MAC fa:16:3e:3b:0e:67, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:15:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:53 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Deleted allocations for instance f74ff2a1-d268-4472-a284-462f00a1d251
Jul 26 17:15:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bc826cbc-917a-457d-b6c9-05e950b8f8a2 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "f74ff2a1-d268-4472-a284-462f00a1d251" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.244s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-306494ac-c3ab-4298-875e-4b888ad730b7 req-45931d60-cbea-4b59-b6ec-a35ea203b67f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-306494ac-c3ab-4298-875e-4b888ad730b7 req-45931d60-cbea-4b59-b6ec-a35ea203b67f service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-306494ac-c3ab-4298-875e-4b888ad730b7 req-45931d60-cbea-4b59-b6ec-a35ea203b67f service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-306494ac-c3ab-4298-875e-4b888ad730b7 req-45931d60-cbea-4b59-b6ec-a35ea203b67f service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-306494ac-c3ab-4298-875e-4b888ad730b7 req-45931d60-cbea-4b59-b6ec-a35ea203b67f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:55 user nova-compute[70594]: WARNING nova.compute.manager [req-306494ac-c3ab-4298-875e-4b888ad730b7 req-45931d60-cbea-4b59-b6ec-a35ea203b67f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state building and task_state spawning.
Jul 26 17:15:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:15:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391756.9752421, 356f54bb-c75c-4e17-8193-65f8a662e572 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:15:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] VM Resumed (Lifecycle Event)
Jul 26 17:15:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:15:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:15:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance spawned successfully.
Jul 26 17:15:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:15:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:15:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391756.978837, 356f54bb-c75c-4e17-8193-65f8a662e572 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:15:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] VM Started (Lifecycle Event)
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:15:57 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:15:57 user nova-compute[70594]: INFO nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Took 5.15 seconds to spawn the instance on the hypervisor.
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:15:57 user nova-compute[70594]: INFO nova.compute.manager [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Took 13.00 seconds to build instance.
Jul 26 17:15:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19136dc7-257d-4afa-99c2-e19cd5656804 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.110s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-94b91a5b-40a3-47f6-a2ef-dba9f284bb33 req-3779a40a-fc33-4a9e-9b1e-4d682cba87f4 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-94b91a5b-40a3-47f6-a2ef-dba9f284bb33 req-3779a40a-fc33-4a9e-9b1e-4d682cba87f4 service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-94b91a5b-40a3-47f6-a2ef-dba9f284bb33 req-3779a40a-fc33-4a9e-9b1e-4d682cba87f4 service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-94b91a5b-40a3-47f6-a2ef-dba9f284bb33 req-3779a40a-fc33-4a9e-9b1e-4d682cba87f4 service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:15:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-94b91a5b-40a3-47f6-a2ef-dba9f284bb33 req-3779a40a-fc33-4a9e-9b1e-4d682cba87f4 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:15:57 user nova-compute[70594]: WARNING nova.compute.manager [req-94b91a5b-40a3-47f6-a2ef-dba9f284bb33 req-3779a40a-fc33-4a9e-9b1e-4d682cba87f4 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state active and task_state None.
Jul 26 17:15:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:16:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:16:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:16:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:16:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:05 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391750.5428646, f74ff2a1-d268-4472-a284-462f00a1d251 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:16:05 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] VM Stopped (Lifecycle Event)
Jul 26 17:16:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-0ed5141f-81e5-4410-95e1-48951cae9bf7 None None] [instance: f74ff2a1-d268-4472-a284-462f00a1d251] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:16:05 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:16:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:12 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:12 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:12 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:15 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:16:15 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:16:15 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7470MB free_disk=25.074012756347656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 35205a75-e9a7-49a5-96f8-57631680ca05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:16:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:16:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:16:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:16:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [{"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-35205a75-e9a7-49a5-96f8-57631680ca05" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:16:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:21 user nova-compute[70594]: INFO nova.compute.manager [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Terminating instance
Jul 26 17:16:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-1361cfeb-ced2-473b-93a0-248c95adf30e req-d54009b8-c7b4-4307-8258-dac54c42a338 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1361cfeb-ced2-473b-93a0-248c95adf30e req-d54009b8-c7b4-4307-8258-dac54c42a338 service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1361cfeb-ced2-473b-93a0-248c95adf30e req-d54009b8-c7b4-4307-8258-dac54c42a338 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1361cfeb-ced2-473b-93a0-248c95adf30e req-d54009b8-c7b4-4307-8258-dac54c42a338 service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-1361cfeb-ced2-473b-93a0-248c95adf30e req-d54009b8-c7b4-4307-8258-dac54c42a338 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-1361cfeb-ced2-473b-93a0-248c95adf30e req-d54009b8-c7b4-4307-8258-dac54c42a338 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-unplugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:16:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Instance destroyed successfully.
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'resources' on Instance uuid 35205a75-e9a7-49a5-96f8-57631680ca05 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1367667271',display_name='tempest-AttachVolumeTestJSON-server-1367667271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1367667271',id=25,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3REb6Yw4LYz2otKJ8EwRepYMhpPvh8y96ldtELSB9/JqHri27Y3GSPzO92LgKaf5Ilji2tvVYaYS/m8rzMGOATC2Mf8QtBRAeCWDpwHTHTsQgELo0IqbTJPYNLztrhPg==',key_name='tempest-keypair-1654457392',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-ogtexl2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=35205a75-e9a7-49a5-96f8-57631680ca05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "address": "fa:16:3e:36:f4:ab", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef9e468-62", "ovs_interfaceid": "5ef9e468-621a-440e-8561-ab66e60d5b8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG os_vif [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef9e468-62, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:16:22 user nova-compute[70594]: INFO os_vif [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f4:ab,bridge_name='br-int',has_traffic_filtering=True,id=5ef9e468-621a-440e-8561-ab66e60d5b8b,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef9e468-62')
Jul 26 17:16:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Deleting instance files /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05_del
Jul 26 17:16:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Deletion of /opt/stack/data/nova/instances/35205a75-e9a7-49a5-96f8-57631680ca05_del complete
Jul 26 17:16:22 user nova-compute[70594]: INFO nova.compute.manager [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 26 17:16:22 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:16:22 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:16:23 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Took 0.93 seconds to deallocate network for instance.
Jul 26 17:16:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-115d873d-173c-4153-b9c2-81cd93d47b14 req-3c52caaf-5bb0-4b25-83d6-e78211182ee2 service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-deleted-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:16:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:23 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Deleted allocations for instance 35205a75-e9a7-49a5-96f8-57631680ca05
Jul 26 17:16:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-918b7468-aded-4fa0-b530-3809543d1e1a tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "35205a75-e9a7-49a5-96f8-57631680ca05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b37c275-3b61-427b-a12b-0a13f1d905eb req-b12de627-f36f-4181-951a-6df70eff62ba service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b37c275-3b61-427b-a12b-0a13f1d905eb req-b12de627-f36f-4181-951a-6df70eff62ba service nova] Acquiring lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b37c275-3b61-427b-a12b-0a13f1d905eb req-b12de627-f36f-4181-951a-6df70eff62ba service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0b37c275-3b61-427b-a12b-0a13f1d905eb req-b12de627-f36f-4181-951a-6df70eff62ba service nova] Lock "35205a75-e9a7-49a5-96f8-57631680ca05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-0b37c275-3b61-427b-a12b-0a13f1d905eb req-b12de627-f36f-4181-951a-6df70eff62ba service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] No waiting events found dispatching network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:24 user nova-compute[70594]: WARNING nova.compute.manager [req-0b37c275-3b61-427b-a12b-0a13f1d905eb req-b12de627-f36f-4181-951a-6df70eff62ba service nova] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Received unexpected event network-vif-plugged-5ef9e468-621a-440e-8561-ab66e60d5b8b for instance with vm_state deleted and task_state None.
Jul 26 17:16:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:26 user nova-compute[70594]: INFO nova.compute.manager [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Terminating instance
Jul 26 17:16:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Instance destroyed successfully.
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lazy-loading 'resources' on Instance uuid 618adbc0-feb7-4fdf-99f2-49ea967ab92d {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1931141150',display_name='tempest-SnapshotDataIntegrityTests-server-1931141150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1931141150',id=30,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKivwAgBNSfRn37eyRiOmILDe6uC7rsYMQ8LHxuo24HsfP+HkSgIxTljPn45XH5HN8VhsPL6Gsgz+OAcn2fL1/lyAdIXMuAjEltdLJZwGnlhm7LAATupDtGu07JrfUUzZQ==',key_name='tempest-keypair-2073314163',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4816177ff0e3447c93af8115e1fabcb7',ramdisk_id='',reservation_id='r-h8cz4yi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-174874440',owner_user_name='tempest-SnapshotDataIntegrityTests-174874440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f600ead8c3664427adbe89df319bb29c',uuid=618adbc0-feb7-4fdf-99f2-49ea967ab92d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Converting VIF {"id": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "address": "fa:16:3e:b1:73:53", "network": {"id": "ca2464a5-74f4-4c4f-b1ec-c9299994012a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1129241921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4816177ff0e3447c93af8115e1fabcb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dbf405-7f", "ovs_interfaceid": "17dbf405-7f7b-4583-8d0a-0b000757a47d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG os_vif [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17dbf405-7f, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:16:27 user nova-compute[70594]: INFO os_vif [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:73:53,bridge_name='br-int',has_traffic_filtering=True,id=17dbf405-7f7b-4583-8d0a-0b000757a47d,network=Network(ca2464a5-74f4-4c4f-b1ec-c9299994012a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dbf405-7f')
Jul 26 17:16:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Deleting instance files /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d_del
Jul 26 17:16:27 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Deletion of /opt/stack/data/nova/instances/618adbc0-feb7-4fdf-99f2-49ea967ab92d_del complete
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-2947a751-1f63-47f2-833e-b4621c9ec31d req-cee6ee53-cccb-488c-801f-598a7cecf3f3 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-vif-unplugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2947a751-1f63-47f2-833e-b4621c9ec31d req-cee6ee53-cccb-488c-801f-598a7cecf3f3 service nova] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2947a751-1f63-47f2-833e-b4621c9ec31d req-cee6ee53-cccb-488c-801f-598a7cecf3f3 service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2947a751-1f63-47f2-833e-b4621c9ec31d req-cee6ee53-cccb-488c-801f-598a7cecf3f3 service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-2947a751-1f63-47f2-833e-b4621c9ec31d req-cee6ee53-cccb-488c-801f-598a7cecf3f3 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] No waiting events found dispatching network-vif-unplugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.compute.manager [req-2947a751-1f63-47f2-833e-b4621c9ec31d req-cee6ee53-cccb-488c-801f-598a7cecf3f3 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-vif-unplugged-17dbf405-7f7b-4583-8d0a-0b000757a47d for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:16:27 user nova-compute[70594]: INFO nova.compute.manager [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 26 17:16:27 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:16:27 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:16:28 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:16:28 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Took 1.27 seconds to deallocate network for instance.
Jul 26 17:16:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:29 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Deleted allocations for instance 618adbc0-feb7-4fdf-99f2-49ea967ab92d
Jul 26 17:16:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-30aab1a7-12a9-431f-96d3-be24b770212a tempest-SnapshotDataIntegrityTests-174874440 tempest-SnapshotDataIntegrityTests-174874440-project-member] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.703s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] Acquiring lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] Lock "618adbc0-feb7-4fdf-99f2-49ea967ab92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] No waiting events found dispatching network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:29 user nova-compute[70594]: WARNING nova.compute.manager [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received unexpected event network-vif-plugged-17dbf405-7f7b-4583-8d0a-0b000757a47d for instance with vm_state deleted and task_state None.
Jul 26 17:16:29 user nova-compute[70594]: DEBUG nova.compute.manager [req-2b9a2a63-5899-4990-8917-29ad0d0ab443 req-3a4b2c5c-ec64-4512-8a6c-e03beaeb1816 service nova] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Received event network-vif-deleted-17dbf405-7f7b-4583-8d0a-0b000757a47d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-changed-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Refreshing instance network info cache due to event network-changed-1f0c63c5-83d2-4858-aa77-1aabc9be4abd. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] Acquiring lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] Acquired lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Refreshing network info cache for port 1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'flavor' on Instance uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updated VIF entry in instance network info cache for port 1f0c63c5-83d2-4858-aa77-1aabc9be4abd. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updating instance_info_cache with network_info: [{"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-16f551f5-8831-4c7a-84dc-6bd1d396c170 req-ae4313f3-e406-42e3-89fa-a0d98fc56978 service nova] Releasing lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:16:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:36 user nova-compute[70594]: INFO nova.compute.manager [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Attaching volume a0764ba8-8444-450d-aa5b-cc9846e298ae to /dev/vdb
Jul 26 17:16:36 user nova-compute[70594]: DEBUG os_brick.utils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d05a14-15e3-4fbc-90a5-26d49174dbc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dff536-483c-437a-93f9-016172b3edf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[20809f87-c4e4-49f5-b9ed-0028e224207c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[70801428-b477-4bb8-a9a1-a801b301b8ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:16:36 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:16:36 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0364e726-43c8-4d39-8a7e-33f85134c887]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG os_brick.utils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updating existing volume attachment record: e94ec986-807d-49ed-9e9d-1bc9db8ffb95 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:16:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:37 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:37 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391782.4502838, 35205a75-e9a7-49a5-96f8-57631680ca05 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:16:37 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] VM Stopped (Lifecycle Event)
Jul 26 17:16:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8316f875-2781-4bb0-8ab7-66d6e24be23c None None] [instance: 35205a75-e9a7-49a5-96f8-57631680ca05] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:16:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-changed-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Refreshing instance network info cache due to event network-changed-27b3ca80-e74a-479a-8846-e3bdc8a2bd33. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:16:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] Acquiring lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:16:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] Acquired lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:16:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Refreshing network info cache for port 27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:16:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updated VIF entry in instance network info cache for port 27b3ca80-e74a-479a-8846-e3bdc8a2bd33. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:16:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updating instance_info_cache with network_info: [{"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:16:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f123ad9b-5e77-43a9-9be2-0b1e7b45e06f req-4aec406d-a838-4f02-9e81-1535e99e9d47 service nova] Releasing lock "refresh_cache-ea2e99b6-1db2-4669-9f88-17ddfebe3461" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:16:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:42 user nova-compute[70594]: INFO nova.compute.manager [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Unrescuing
Jul 26 17:16:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquired lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391787.4087384, 618adbc0-feb7-4fdf-99f2-49ea967ab92d => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:16:42 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] VM Stopped (Lifecycle Event)
Jul 26 17:16:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d2dbb367-710b-452c-acae-af65d079c8ee None None] [instance: 618adbc0-feb7-4fdf-99f2-49ea967ab92d] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG nova.network.neutron [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating instance_info_cache with network_info: [{"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Releasing lock "refresh_cache-aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'flavor' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-b4f6a3be-8afb-496c-a46f-e64382ce949f req-fa5ae32e-7b40-421b-9c7d-397a3189ea0e service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b4f6a3be-8afb-496c-a46f-e64382ce949f req-fa5ae32e-7b40-421b-9c7d-397a3189ea0e service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b4f6a3be-8afb-496c-a46f-e64382ce949f req-fa5ae32e-7b40-421b-9c7d-397a3189ea0e service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b4f6a3be-8afb-496c-a46f-e64382ce949f req-fa5ae32e-7b40-421b-9c7d-397a3189ea0e service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-b4f6a3be-8afb-496c-a46f-e64382ce949f req-fa5ae32e-7b40-421b-9c7d-397a3189ea0e service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:43 user nova-compute[70594]: WARNING nova.compute.manager [req-b4f6a3be-8afb-496c-a46f-e64382ce949f req-fa5ae32e-7b40-421b-9c7d-397a3189ea0e service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:16:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance destroyed successfully.
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:44 user nova-compute[70594]: INFO nova.compute.manager [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Attaching volume 78bd9fd4-e775-4acb-be49-14d5c691a995 to /dev/vdb
Jul 26 17:16:44 user nova-compute[70594]: DEBUG os_brick.utils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba84978-68c3-4804-a27d-211024825be3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad0cd8c-739c-49c0-954b-00994f3f4790]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b06328-181c-4d4f-a6fa-cd27a9348052]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e03aef-002b-4112-b17c-0a9b09ed95f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:16:44 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:16:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ecf75-5c41-4fb6-968f-1cdc9534f193]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG os_brick.utils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updating existing volume attachment record: 3342864e-6e53-4ff0-abde-7071742e399d {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:45 user nova-compute[70594]: WARNING nova.compute.manager [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:16:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:45 user nova-compute[70594]: WARNING nova.compute.manager [req-00f0e918-97ca-4bc9-badc-57304bca41e7 req-7904b317-4f90-48aa-8339-9aa394bd7e9b service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state rescued and task_state unrescuing.
Jul 26 17:16:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Removed pending event for aa0cbb71-bab6-4f6a-afa1-24c26c851f9f due to event {{(pid=70594) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391807.0519369, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:16:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Resumed (Lifecycle Event)
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b0114177-e4e6-43b6-abca-5a0309ac29ef tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:16:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391807.0535274, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:16:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Started (Lifecycle Event)
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-089952c1-6955-41f6-9a7b-c0fb4e04c4cf req-d411a420-145f-4357-bd5f-e4253dbcdb68 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-089952c1-6955-41f6-9a7b-c0fb4e04c4cf req-d411a420-145f-4357-bd5f-e4253dbcdb68 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-089952c1-6955-41f6-9a7b-c0fb4e04c4cf req-d411a420-145f-4357-bd5f-e4253dbcdb68 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-089952c1-6955-41f6-9a7b-c0fb4e04c4cf req-d411a420-145f-4357-bd5f-e4253dbcdb68 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-089952c1-6955-41f6-9a7b-c0fb4e04c4cf req-d411a420-145f-4357-bd5f-e4253dbcdb68 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:16:47 user nova-compute[70594]: WARNING nova.compute.manager [req-089952c1-6955-41f6-9a7b-c0fb4e04c4cf req-d411a420-145f-4357-bd5f-e4253dbcdb68 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state None.
Jul 26 17:16:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guWoqjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:16:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:16:50 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:16:50 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa89dc-2c8f-444a-8031-eb0368ece333]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:16:50 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb45ebe0-e05a-4112-9a1f-347bc93d31ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae] added
Jul 26 17:16:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012b175-f776-4975-8fb4-6283e2403acb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[810dafb1-c3a5-4cae-b14c-5c1820ad330d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guWoqjIt {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guWoqjIt" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb09264-58b5-4f6b-bb90-91177eafeae0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'guWoqjIt'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e029d202-2a35-406d-9717-1af730e0ba02]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca17586-c28e-4087-af2f-d6258b79a7e6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f75162-ed7c-4480-91ce-e4ec821d84ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260]
Jul 26 17:16:50 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260] successful.
Jul 26 17:16:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a192a3a-e39a-4ff9-b7f8-a5413c7d38fc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[af55e13d-2621-4950-a59e-efb585b9b690]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae (non-flash)
Jul 26 17:16:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:16:50 user nova-compute[70594]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae (non-flash)
Jul 26 17:16:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5825d53-550e-4227-ac32-3eb2229ba840]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guWoqjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23734623331373834', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734623331373834', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'flavor' on Instance uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:16:51 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:16:51 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:16:51 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:16:51 user nova-compute[70594]:   <serial>a0764ba8-8444-450d-aa5b-cc9846e298ae</serial>
Jul 26 17:16:51 user nova-compute[70594]: </disk>
Jul 26 17:16:51 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:16:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No VIF found with MAC fa:16:3e:90:62:79, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:16:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fad543ea-0725-44c8-a23e-2ca047f88e55 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.971s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:54 user nova-compute[70594]: INFO nova.compute.manager [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Detaching volume a0764ba8-8444-450d-aa5b-cc9846e298ae
Jul 26 17:16:54 user nova-compute[70594]: INFO nova.virt.block_device [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Attempting to driver detach volume a0764ba8-8444-450d-aa5b-cc9846e298ae from mountpoint /dev/vdb
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Attempting to detach device vdb from instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:16:54 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:16:54 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:16:54 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:16:54 user nova-compute[70594]:   <serial>a0764ba8-8444-450d-aa5b-cc9846e298ae</serial>
Jul 26 17:16:54 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:16:54 user nova-compute[70594]: </disk>
Jul 26 17:16:54 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:16:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully detached device vdb from instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 from the persistent domain config.
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:16:54 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:16:54 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:16:54 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:16:54 user nova-compute[70594]:   <serial>a0764ba8-8444-450d-aa5b-cc9846e298ae</serial>
Jul 26 17:16:54 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:16:54 user nova-compute[70594]: </disk>
Jul 26 17:16:54 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391814.5548797, e3deb93d-2ad8-45fa-91f1-68d48dea5637 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:16:54 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully detached device vdb from instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 from the live domain config.
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guWoqjIt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:16:54 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbe0f15-4216-4008-878e-1582056dcc5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:16:54 user nova-compute[70594]: No targets found.
Jul 26 17:16:54 user nova-compute[70594]: iSNS:
Jul 26 17:16:54 user nova-compute[70594]: No targets found.
Jul 26 17:16:54 user nova-compute[70594]: STATIC:
Jul 26 17:16:54 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:16:54 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:16:54 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:16:54 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:16:54 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:16:54 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:16:54 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae
Jul 26 17:16:54 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:16:54 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:16:54 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:16:54 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:16:54 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:16:54 user nova-compute[70594]: FIRMWARE:
Jul 26 17:16:54 user nova-compute[70594]: No targets found.
Jul 26 17:16:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:16:54 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:16:54 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dff1fd7-e6f7-422f-ac34-d663f45901b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fbf882-c50a-40ca-9b4e-805b7ef03efc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:16:54 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:16:54 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:16:54 user nova-compute[70594]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae (non-flash)
Jul 26 17:16:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:16:54 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:16:54 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:16:54 user nova-compute[70594]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae (non-flash)
Jul 26 17:16:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910313b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8778964-d60e-4a71-b304-5b3f604dd0c2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f876d080-5f13-4ec7-8385-a608f0330679]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23acd979-24c7-4c75-b989-57795523f82b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c976b-aef5-403e-8ffb-59c7798fcf1e]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af6ddbb-22b5-4a73-aab2-6e96b3815d7a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c475cf-a640-4728-b8f5-ddaf6c468da4]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260]
Jul 26 17:16:54 user nova-compute[70594]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae, portal: 172.16.0.220,3260] successful.
Jul 26 17:16:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0764ba8-8444-450d-aa5b-cc9846e298ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e869795-8392-4eca-a268-56d95fcfa024]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] <== disconnect_volume: return (346ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:16:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:16:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'flavor' on Instance uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:16:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7b155578-b662-4bc0-b79f-e99412807a3c tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.690s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:16:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:16:58 user nova-compute[70594]: INFO nova.compute.claims [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Claim successful on node user
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:16:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:16:58 user nova-compute[70594]: INFO nova.virt.block_device [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Booting with volume bb1818be-7545-48ac-8df9-acbba4ebbe64 at /dev/vda
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.policy [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd221b17924ce3b9770c36fbbb52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f39be2f463416faaeae34d088bb57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG os_brick.utils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[205790df-2da6-4679-82f0-a6daa9ca479f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[961cfc87-8f36-45c7-9449-f4ee31648c66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665e8a8-c2fa-40f2-86b8-1ec96167003d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e1dbb2-ec4a-4855-9a86-c358f031ce48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:16:58 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:16:58 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2080c28a-2d03-47d3-b8f2-f9a331740ae4]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG os_brick.utils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:16:58 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updating existing volume attachment record: f54f299b-d74a-4b1f-8da9-bf425dd3812b {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:16:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Successfully created port: ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Successfully updated port: ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquired lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-changed-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Refreshing instance network info cache due to event network-changed-ebd10397-3239-4b56-a47b-5e53ec0ac80d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] Acquiring lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acCJvNTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:17:00 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:00 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:00 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e9bc8-852d-46e9-be08-6bdb1a3d31d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:17:00 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc8dfc-765a-4e6d-84ab-dd2030379152]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995] added
Jul 26 17:17:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828900b-db52-451e-a4aa-ba68e3c49c0c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32daa3c1-7b02-4ddd-8ae1-e3ddbf35c354]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updating instance_info_cache with network_info: [{"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acCJvNTd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Releasing lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Instance network_info: |[{"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acCJvNTd" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] Acquired lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG nova.network.neutron [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Refreshing network info cache for port ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179108a-770d-47a1-b965-b1a6861845d9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'acCJvNTd'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e20ddab-fb0c-4e18-9cfc-5ad76f980a04]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4379d1b5-0848-4d98-abb8-9581bcdac90b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8773a89a-d5f6-489c-ad21-0ece1af23de7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260]
Jul 26 17:17:01 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260] successful.
Jul 26 17:17:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b951e56-cd6a-45bc-b8be-c4e05a3ff010]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[533214cd-f616-4bbd-aebc-ecb3401fb0ea]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 (non-flash)
Jul 26 17:17:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd102c0-cfdd-464b-a8b5-34a8b386f525]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updated VIF entry in instance network info cache for port ebd10397-3239-4b56-a47b-5e53ec0ac80d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updating instance_info_cache with network_info: [{"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-fc31b893-13f9-4ecd-a373-cb15590db877 req-24b92f19-d67b-418d-84ee-30967f7f1f47 service nova] Releasing lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acCJvNTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23038623535373437', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038623535373437', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG nova.objects.instance [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:17:02 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:17:02 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:17:02 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:17:02 user nova-compute[70594]:   <serial>78bd9fd4-e775-4acb-be49-14d5c691a995</serial>
Jul 26 17:17:02 user nova-compute[70594]: </disk>
Jul 26 17:17:02 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:84:2c:5b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:17:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-61e2a0f4-66dc-4bd9-b7dd-ff4e7b4b4b83 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.280s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:04 user nova-compute[70594]: INFO nova.compute.manager [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Detaching volume 78bd9fd4-e775-4acb-be49-14d5c691a995
Jul 26 17:17:04 user nova-compute[70594]: INFO nova.virt.block_device [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Attempting to driver detach volume 78bd9fd4-e775-4acb-be49-14d5c691a995 from mountpoint /dev/vdb
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Attempting to detach device vdb from instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:17:04 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:17:04 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:17:04 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:17:04 user nova-compute[70594]:   <serial>78bd9fd4-e775-4acb-be49-14d5c691a995</serial>
Jul 26 17:17:04 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:17:04 user nova-compute[70594]: </disk>
Jul 26 17:17:04 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:17:04 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully detached device vdb from instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 from the persistent domain config.
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:17:04 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:17:04 user nova-compute[70594]:   <source dev="/dev/sde"/>
Jul 26 17:17:04 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:17:04 user nova-compute[70594]:   <serial>78bd9fd4-e775-4acb-be49-14d5c691a995</serial>
Jul 26 17:17:04 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:17:04 user nova-compute[70594]: </disk>
Jul 26 17:17:04 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391824.7569935, ea2e99b6-1db2-4669-9f88-17ddfebe3461 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:17:04 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully detached device vdb from instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 from the live domain config.
Jul 26 17:17:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acCJvNTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:17:04 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e20cf-7d01-4e69-9748-bf61a53920a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:17:04 user nova-compute[70594]: No targets found.
Jul 26 17:17:04 user nova-compute[70594]: iSNS:
Jul 26 17:17:04 user nova-compute[70594]: No targets found.
Jul 26 17:17:04 user nova-compute[70594]: STATIC:
Jul 26 17:17:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:17:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:17:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:17:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995
Jul 26 17:17:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:04 user nova-compute[70594]: FIRMWARE:
Jul 26 17:17:04 user nova-compute[70594]: No targets found.
Jul 26 17:17:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:17:04 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:17:04 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c561ea-bd4a-44ff-bbcc-25e33d8392ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7fcf62-f330-4162-a8b4-a2daf37d9243]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:04 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:04 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:04 user nova-compute[70594]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 (non-flash)
Jul 26 17:17:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:04 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:04 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:04 user nova-compute[70594]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 (non-flash)
Jul 26 17:17:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910311bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c8a6bf-f707-46ce-b7b9-07addf01d8db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e26f68b-44e3-43c1-8547-55bf4e940f9e]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3cdd17-e7b7-4c64-ad53-7e6bcdcec9ab]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66fd06d-c8d3-42bd-9c7f-dd4e69175c0f]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8190b9-cd09-42e3-9730-ff69495c90d4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ca933-ca07-417f-a865-06f683077521]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260]
Jul 26 17:17:05 user nova-compute[70594]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995, portal: 172.16.0.220,3260] successful.
Jul 26 17:17:05 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bd9fd4-e775-4acb-be49-14d5c691a995 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df81ef-5fcc-454a-a648-24c9b569fb1e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== disconnect_volume: return (324ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:17:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:17:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Creating image(s)
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Ensure instance console log exists: /opt/stack/data/nova/instances/70df069f-5f6c-4463-aa0d-4a323de18b10/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Start _get_guest_xml network_info=[{"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSQgZwEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70df069f-5f6c-4463-aa0d-4a323de18b10', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb1818be-7545-48ac-8df9-acbba4ebbe64', 'serial': 'bb1818be-7545-48ac-8df9-acbba4ebbe64'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'f54f299b-d74a-4b1f-8da9-bf425dd3812b', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:17:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:06 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSQgZwEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:17:06 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:06 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:06 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfdfe52-e0cd-4757-80f6-5828e996a99b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:17:06 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[743a29c2-b613-4bd5-bb29-55760b3159a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64] added
Jul 26 17:17:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdca081-fdbc-4cb4-872d-117e5d7ee390]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f488136-be91-4119-8d7f-609342d0a7ae]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSQgZwEp {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSQgZwEp" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc6d1d-07cb-44f0-932a-40d791b5b489]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NSQgZwEp'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6fb906-f3bc-4835-88ca-41902a8e12c6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a51da46-474a-41fb-aec9-630f460ac6f1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b2258-b66b-4172-a637-3c42ee8fb53d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260]
Jul 26 17:17:06 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260] successful.
Jul 26 17:17:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa57daaa-eb44-4166-94c0-ccc6e8371ba8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a266030-ea2f-4b5b-8148-61be5e3e8ba1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:06 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d6105a-a2be-49be-bdfa-c6aa55499bae]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSQgZwEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG nova.objects.instance [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-39b77c2f-ec80-4550-ba65-670ab3fee8b1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.474s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23937636637646466', 'path': '/dev/sde'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937636637646466', 'path': '/dev/sde'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-874250262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-874250262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-874250262',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+YFcbvejK3g8V8neDye/1AQXlbMqm45FtKaTQ2K8lr5VPnkh/pVEaPhFbJLi1Xbu52uyS3LwcXPXbsj5TovNLmpMJOhPEylIDEx9GH6HBj7FFYhL34zD6SkNo/1vsEeg==',key_name='tempest-keypair-1042358430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-pyg08f44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=70df069f-5f6c-4463-aa0d-4a323de18b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.objects.instance [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'pci_devices' on Instance uuid 70df069f-5f6c-4463-aa0d-4a323de18b10 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:17:07 user nova-compute[70594]:   <uuid>70df069f-5f6c-4463-aa0d-4a323de18b10</uuid>
Jul 26 17:17:07 user nova-compute[70594]:   <name>instance-00000027</name>
Jul 26 17:17:07 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:17:07 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:17:07 user nova-compute[70594]:   <metadata>
Jul 26 17:17:07 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:17:07 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:17:07 user nova-compute[70594]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-874250262</nova:name>
Jul 26 17:17:07 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:17:06</nova:creationTime>
Jul 26 17:17:07 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:17:07 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:17:07 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:17:07 user nova-compute[70594]:       <nova:owner>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:user uuid="68fd221b17924ce3b9770c36fbbb52df">tempest-TestVolumeBootPattern-491432484-project-member</nova:user>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:project uuid="05f39be2f463416faaeae34d088bb57c">tempest-TestVolumeBootPattern-491432484</nova:project>
Jul 26 17:17:07 user nova-compute[70594]:       </nova:owner>
Jul 26 17:17:07 user nova-compute[70594]:       <nova:ports>
Jul 26 17:17:07 user nova-compute[70594]:         <nova:port uuid="ebd10397-3239-4b56-a47b-5e53ec0ac80d">
Jul 26 17:17:07 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 26 17:17:07 user nova-compute[70594]:         </nova:port>
Jul 26 17:17:07 user nova-compute[70594]:       </nova:ports>
Jul 26 17:17:07 user nova-compute[70594]:     </nova:instance>
Jul 26 17:17:07 user nova-compute[70594]:   </metadata>
Jul 26 17:17:07 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:17:07 user nova-compute[70594]:     <system>
Jul 26 17:17:07 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:17:07 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:17:07 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:17:07 user nova-compute[70594]:       <entry name="serial">70df069f-5f6c-4463-aa0d-4a323de18b10</entry>
Jul 26 17:17:07 user nova-compute[70594]:       <entry name="uuid">70df069f-5f6c-4463-aa0d-4a323de18b10</entry>
Jul 26 17:17:07 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:17:07 user nova-compute[70594]:     </system>
Jul 26 17:17:07 user nova-compute[70594]:   </sysinfo>
Jul 26 17:17:07 user nova-compute[70594]:   <os>
Jul 26 17:17:07 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:17:07 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:17:07 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:17:07 user nova-compute[70594]:   </os>
Jul 26 17:17:07 user nova-compute[70594]:   <features>
Jul 26 17:17:07 user nova-compute[70594]:     <acpi/>
Jul 26 17:17:07 user nova-compute[70594]:     <apic/>
Jul 26 17:17:07 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:17:07 user nova-compute[70594]:   </features>
Jul 26 17:17:07 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:17:07 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:17:07 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:17:07 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:17:07 user nova-compute[70594]:   </clock>
Jul 26 17:17:07 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:17:07 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:17:07 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:17:07 user nova-compute[70594]:   </cpu>
Jul 26 17:17:07 user nova-compute[70594]:   <devices>
Jul 26 17:17:07 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:17:07 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:17:07 user nova-compute[70594]:       <source dev="/dev/sde"/>
Jul 26 17:17:07 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:17:07 user nova-compute[70594]:       <serial>bb1818be-7545-48ac-8df9-acbba4ebbe64</serial>
Jul 26 17:17:07 user nova-compute[70594]:     </disk>
Jul 26 17:17:07 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:17:07 user nova-compute[70594]:       <mac address="fa:16:3e:4c:79:a4"/>
Jul 26 17:17:07 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:17:07 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:17:07 user nova-compute[70594]:       <target dev="tapebd10397-32"/>
Jul 26 17:17:07 user nova-compute[70594]:     </interface>
Jul 26 17:17:07 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:17:07 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/70df069f-5f6c-4463-aa0d-4a323de18b10/console.log" append="off"/>
Jul 26 17:17:07 user nova-compute[70594]:     </serial>
Jul 26 17:17:07 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:17:07 user nova-compute[70594]:     <video>
Jul 26 17:17:07 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:17:07 user nova-compute[70594]:     </video>
Jul 26 17:17:07 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:17:07 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:17:07 user nova-compute[70594]:     </rng>
Jul 26 17:17:07 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:17:07 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:17:07 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:17:07 user nova-compute[70594]:     </memballoon>
Jul 26 17:17:07 user nova-compute[70594]:   </devices>
Jul 26 17:17:07 user nova-compute[70594]: </domain>
Jul 26 17:17:07 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-874250262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-874250262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-874250262',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+YFcbvejK3g8V8neDye/1AQXlbMqm45FtKaTQ2K8lr5VPnkh/pVEaPhFbJLi1Xbu52uyS3LwcXPXbsj5TovNLmpMJOhPEylIDEx9GH6HBj7FFYhL34zD6SkNo/1vsEeg==',key_name='tempest-keypair-1042358430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-pyg08f44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=70df069f-5f6c-4463-aa0d-4a323de18b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG os_vif [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd10397-32, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebd10397-32, col_values=(('external_ids', {'iface-id': 'ebd10397-3239-4b56-a47b-5e53ec0ac80d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:79:a4', 'vm-uuid': '70df069f-5f6c-4463-aa0d-4a323de18b10'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:07 user nova-compute[70594]: INFO os_vif [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32')
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No VIF found with MAC fa:16:3e:4c:79:a4, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:17:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG nova.compute.manager [req-6e5b26e4-e18b-49f6-b530-f98f908f69f3 req-ad356780-eb42-4f2d-a16c-29a6628546f0 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6e5b26e4-e18b-49f6-b530-f98f908f69f3 req-ad356780-eb42-4f2d-a16c-29a6628546f0 service nova] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6e5b26e4-e18b-49f6-b530-f98f908f69f3 req-ad356780-eb42-4f2d-a16c-29a6628546f0 service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6e5b26e4-e18b-49f6-b530-f98f908f69f3 req-ad356780-eb42-4f2d-a16c-29a6628546f0 service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG nova.compute.manager [req-6e5b26e4-e18b-49f6-b530-f98f908f69f3 req-ad356780-eb42-4f2d-a16c-29a6628546f0 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] No waiting events found dispatching network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:09 user nova-compute[70594]: WARNING nova.compute.manager [req-6e5b26e4-e18b-49f6-b530-f98f908f69f3 req-ad356780-eb42-4f2d-a16c-29a6628546f0 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received unexpected event network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d for instance with vm_state building and task_state spawning.
Jul 26 17:17:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:10 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391830.9952693, 70df069f-5f6c-4463-aa0d-4a323de18b10 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:10 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] VM Resumed (Lifecycle Event)
Jul 26 17:17:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:17:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:17:11 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Instance spawned successfully.
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391830.9966433, 70df069f-5f6c-4463-aa0d-4a323de18b10 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] VM Started (Lifecycle Event)
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:17:11 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-1c469065-d907-4784-94df-b6c6fa967c47 req-d67916e5-3f1a-469f-a766-f0a736a7c11d service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1c469065-d907-4784-94df-b6c6fa967c47 req-d67916e5-3f1a-469f-a766-f0a736a7c11d service nova] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1c469065-d907-4784-94df-b6c6fa967c47 req-d67916e5-3f1a-469f-a766-f0a736a7c11d service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1c469065-d907-4784-94df-b6c6fa967c47 req-d67916e5-3f1a-469f-a766-f0a736a7c11d service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-1c469065-d907-4784-94df-b6c6fa967c47 req-d67916e5-3f1a-469f-a766-f0a736a7c11d service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] No waiting events found dispatching network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:11 user nova-compute[70594]: WARNING nova.compute.manager [req-1c469065-d907-4784-94df-b6c6fa967c47 req-d67916e5-3f1a-469f-a766-f0a736a7c11d service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received unexpected event network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d for instance with vm_state building and task_state spawning.
Jul 26 17:17:11 user nova-compute[70594]: INFO nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Took 5.13 seconds to spawn the instance on the hypervisor.
Jul 26 17:17:11 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:11 user nova-compute[70594]: INFO nova.compute.manager [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Took 13.15 seconds to build instance.
Jul 26 17:17:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4a49eccd-9e79-4011-84b7-6673a84a6bed tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.248s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:12 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:13 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:16 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:16 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.126178741455078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 70df069f-5f6c-4463-aa0d-4a323de18b10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 808c3361-0697-42f4-bea3-5107c614ef0f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1726}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.424s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:17:16 user nova-compute[70594]: INFO nova.compute.claims [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Claim successful on node user
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:17:16 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.network.neutron [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:17:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:17:17 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Creating image(s)
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "/opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "/opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "/opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.policy [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c300fdc9bda48b1afdd00fbc5a6245e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0459f7d07ec54e3bbfe3915b2b7cfd7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.216s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk 1073741824" returned: 0 in 0.073s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:17:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Cannot resize image /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG nova.objects.instance [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'migration_context' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Ensure instance console log exists: /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:18 user nova-compute[70594]: DEBUG nova.network.neutron [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Successfully created port: 13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Successfully updated port: 13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquired lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-changed-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.compute.manager [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Refreshing instance network info cache due to event network-changed-13246c09-d31b-4121-9f1d-8989d931a33d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] Acquiring lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:17:19 user nova-compute[70594]: DEBUG nova.network.neutron [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating instance_info_cache with network_info: [{"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Releasing lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Instance network_info: |[{"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] Acquired lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.neutron [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Refreshing network info cache for port 13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Start _get_guest_xml network_info=[{"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:17:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776825008',display_name='tempest-AttachVolumeTestJSON-server-776825008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776825008',id=40,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyAn55gbm6eUVcAiVtZBdgTC174rlpfvjj64SochTlgUtHgk2ZWHDfgcL0nFnc6VKusmuP2wMHuNlEQ+b41znQgtg+Y2aK5+Q75cwP6E2rj4fL9G2A91poCNc0R7WdFHQ==',key_name='tempest-keypair-1979327711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-08aowyuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=808c3361-0697-42f4-bea3-5107c614ef0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.objects.instance [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'pci_devices' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:17:20 user nova-compute[70594]:   <uuid>808c3361-0697-42f4-bea3-5107c614ef0f</uuid>
Jul 26 17:17:20 user nova-compute[70594]:   <name>instance-00000028</name>
Jul 26 17:17:20 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:17:20 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:17:20 user nova-compute[70594]:   <metadata>
Jul 26 17:17:20 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:17:20 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:17:20 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeTestJSON-server-776825008</nova:name>
Jul 26 17:17:20 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:17:20</nova:creationTime>
Jul 26 17:17:20 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:17:20 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:17:20 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:17:20 user nova-compute[70594]:       <nova:owner>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:user uuid="5c300fdc9bda48b1afdd00fbc5a6245e">tempest-AttachVolumeTestJSON-35291756-project-member</nova:user>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:project uuid="0459f7d07ec54e3bbfe3915b2b7cfd7b">tempest-AttachVolumeTestJSON-35291756</nova:project>
Jul 26 17:17:20 user nova-compute[70594]:       </nova:owner>
Jul 26 17:17:20 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:17:20 user nova-compute[70594]:       <nova:ports>
Jul 26 17:17:20 user nova-compute[70594]:         <nova:port uuid="13246c09-d31b-4121-9f1d-8989d931a33d">
Jul 26 17:17:20 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 26 17:17:20 user nova-compute[70594]:         </nova:port>
Jul 26 17:17:20 user nova-compute[70594]:       </nova:ports>
Jul 26 17:17:20 user nova-compute[70594]:     </nova:instance>
Jul 26 17:17:20 user nova-compute[70594]:   </metadata>
Jul 26 17:17:20 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:17:20 user nova-compute[70594]:     <system>
Jul 26 17:17:20 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:17:20 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:17:20 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:17:20 user nova-compute[70594]:       <entry name="serial">808c3361-0697-42f4-bea3-5107c614ef0f</entry>
Jul 26 17:17:20 user nova-compute[70594]:       <entry name="uuid">808c3361-0697-42f4-bea3-5107c614ef0f</entry>
Jul 26 17:17:20 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:17:20 user nova-compute[70594]:     </system>
Jul 26 17:17:20 user nova-compute[70594]:   </sysinfo>
Jul 26 17:17:20 user nova-compute[70594]:   <os>
Jul 26 17:17:20 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:17:20 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:17:20 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:17:20 user nova-compute[70594]:   </os>
Jul 26 17:17:20 user nova-compute[70594]:   <features>
Jul 26 17:17:20 user nova-compute[70594]:     <acpi/>
Jul 26 17:17:20 user nova-compute[70594]:     <apic/>
Jul 26 17:17:20 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:17:20 user nova-compute[70594]:   </features>
Jul 26 17:17:20 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:17:20 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:17:20 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:17:20 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:17:20 user nova-compute[70594]:   </clock>
Jul 26 17:17:20 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:17:20 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:17:20 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:17:20 user nova-compute[70594]:   </cpu>
Jul 26 17:17:20 user nova-compute[70594]:   <devices>
Jul 26 17:17:20 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:17:20 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:17:20 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk"/>
Jul 26 17:17:20 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:17:20 user nova-compute[70594]:     </disk>
Jul 26 17:17:20 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:17:20 user nova-compute[70594]:       <mac address="fa:16:3e:6e:5c:32"/>
Jul 26 17:17:20 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:17:20 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:17:20 user nova-compute[70594]:       <target dev="tap13246c09-d3"/>
Jul 26 17:17:20 user nova-compute[70594]:     </interface>
Jul 26 17:17:20 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:17:20 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/console.log" append="off"/>
Jul 26 17:17:20 user nova-compute[70594]:     </serial>
Jul 26 17:17:20 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:17:20 user nova-compute[70594]:     <video>
Jul 26 17:17:20 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:17:20 user nova-compute[70594]:     </video>
Jul 26 17:17:20 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:17:20 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:17:20 user nova-compute[70594]:     </rng>
Jul 26 17:17:20 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:17:20 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:17:20 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:17:20 user nova-compute[70594]:     </memballoon>
Jul 26 17:17:20 user nova-compute[70594]:   </devices>
Jul 26 17:17:20 user nova-compute[70594]: </domain>
Jul 26 17:17:20 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776825008',display_name='tempest-AttachVolumeTestJSON-server-776825008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776825008',id=40,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyAn55gbm6eUVcAiVtZBdgTC174rlpfvjj64SochTlgUtHgk2ZWHDfgcL0nFnc6VKusmuP2wMHuNlEQ+b41znQgtg+Y2aK5+Q75cwP6E2rj4fL9G2A91poCNc0R7WdFHQ==',key_name='tempest-keypair-1979327711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-08aowyuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=808c3361-0697-42f4-bea3-5107c614ef0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG os_vif [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13246c09-d3, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13246c09-d3, col_values=(('external_ids', {'iface-id': '13246c09-d31b-4121-9f1d-8989d931a33d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:5c:32', 'vm-uuid': '808c3361-0697-42f4-bea3-5107c614ef0f'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:20 user nova-compute[70594]: INFO os_vif [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3')
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No VIF found with MAC fa:16:3e:6e:5c:32, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.neutron [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updated VIF entry in instance network info cache for port 13246c09-d31b-4121-9f1d-8989d931a33d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG nova.network.neutron [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating instance_info_cache with network_info: [{"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ede442bc-c3e4-48cf-ace7-80b36836c2f2 req-6677d500-da24-47e6-a05b-bbb908feaf83 service nova] Releasing lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-d33108c4-df14-4343-a5e1-12bf40b1d34f req-7d560049-64af-465a-b846-2254b9383b7e service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d33108c4-df14-4343-a5e1-12bf40b1d34f req-7d560049-64af-465a-b846-2254b9383b7e service nova] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d33108c4-df14-4343-a5e1-12bf40b1d34f req-7d560049-64af-465a-b846-2254b9383b7e service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d33108c4-df14-4343-a5e1-12bf40b1d34f req-7d560049-64af-465a-b846-2254b9383b7e service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-d33108c4-df14-4343-a5e1-12bf40b1d34f req-7d560049-64af-465a-b846-2254b9383b7e service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] No waiting events found dispatching network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:21 user nova-compute[70594]: WARNING nova.compute.manager [req-d33108c4-df14-4343-a5e1-12bf40b1d34f req-7d560049-64af-465a-b846-2254b9383b7e service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received unexpected event network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d for instance with vm_state building and task_state spawning.
Jul 26 17:17:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-af7c86d9-682a-450c-ac73-54f508c72fc1 req-aafbf155-99cf-42e9-a4f3-293f8a01c928 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af7c86d9-682a-450c-ac73-54f508c72fc1 req-aafbf155-99cf-42e9-a4f3-293f8a01c928 service nova] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af7c86d9-682a-450c-ac73-54f508c72fc1 req-aafbf155-99cf-42e9-a4f3-293f8a01c928 service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af7c86d9-682a-450c-ac73-54f508c72fc1 req-aafbf155-99cf-42e9-a4f3-293f8a01c928 service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-af7c86d9-682a-450c-ac73-54f508c72fc1 req-aafbf155-99cf-42e9-a4f3-293f8a01c928 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] No waiting events found dispatching network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:23 user nova-compute[70594]: WARNING nova.compute.manager [req-af7c86d9-682a-450c-ac73-54f508c72fc1 req-aafbf155-99cf-42e9-a4f3-293f8a01c928 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received unexpected event network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d for instance with vm_state building and task_state spawning.
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391844.0408823, 808c3361-0697-42f4-bea3-5107c614ef0f => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] VM Resumed (Lifecycle Event)
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Instance spawned successfully.
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391844.0422146, 808c3361-0697-42f4-bea3-5107c614ef0f => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] VM Started (Lifecycle Event)
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Took 6.98 seconds to spawn the instance on the hypervisor.
Jul 26 17:17:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:24 user nova-compute[70594]: INFO nova.compute.manager [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Took 8.16 seconds to build instance.
Jul 26 17:17:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-77db40c9-de79-4d43-9ee1-ef5259525c57 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.291s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-changed-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Refreshing instance network info cache due to event network-changed-fd093a50-c11a-4ba5-b451-63176c04f7a8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:17:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] Acquiring lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] Acquired lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Refreshing network info cache for port fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:17:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updated VIF entry in instance network info cache for port fd093a50-c11a-4ba5-b451-63176c04f7a8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:17:36 user nova-compute[70594]: DEBUG nova.network.neutron [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a51bf2e0-7537-4318-9062-59ba338999ab req-030cc246-62bc-4df5-9e73-815a653533cd service nova] Releasing lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Stashing vm_state: active {{(pid=70594) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.objects.instance [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'pci_requests' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:17:37 user nova-compute[70594]: INFO nova.compute.claims [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Claim successful on node user
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.objects.instance [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'resources' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.objects.instance [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'pci_devices' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:37 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating resource usage from migration dd4ae860-67e8-4491-a24e-bb74e44fef57
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-changed-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Refreshing instance network info cache due to event network-changed-333cb45e-2afd-421e-bfbb-99c24655ba0d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] Acquiring lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] Acquired lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Refreshing network info cache for port 333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.602s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:37 user nova-compute[70594]: INFO nova.compute.manager [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Migrating
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updated VIF entry in instance network info cache for port 333cb45e-2afd-421e-bfbb-99c24655ba0d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-56a08095-3cdb-4e65-8979-ccd0c9f76a51 req-cf1888ae-ec3e-4c6e-b86f-bb2e45cf2894 service nova] Releasing lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquired lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:37 user nova-compute[70594]: DEBUG nova.network.neutron [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG nova.network.neutron [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Releasing lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Starting migrate_disk_and_power_off {{(pid=70594) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-b8767bcc-1e60-4b6a-b238-000ecbd3ceb4 req-a82c2315-0abb-4454-846e-e267ae865cab service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-unplugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b8767bcc-1e60-4b6a-b238-000ecbd3ceb4 req-a82c2315-0abb-4454-846e-e267ae865cab service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b8767bcc-1e60-4b6a-b238-000ecbd3ceb4 req-a82c2315-0abb-4454-846e-e267ae865cab service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b8767bcc-1e60-4b6a-b238-000ecbd3ceb4 req-a82c2315-0abb-4454-846e-e267ae865cab service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG nova.compute.manager [req-b8767bcc-1e60-4b6a-b238-000ecbd3ceb4 req-a82c2315-0abb-4454-846e-e267ae865cab service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-unplugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:38 user nova-compute[70594]: WARNING nova.compute.manager [req-b8767bcc-1e60-4b6a-b238-000ecbd3ceb4 req-a82c2315-0abb-4454-846e-e267ae865cab service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-unplugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state active and task_state resize_migrating.
Jul 26 17:17:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance destroyed successfully.
Jul 26 17:17:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1398093165',display_name='tempest-ServerActionsTestOtherA-server-1398093165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1398093165',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-f8ds1v5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=356f54bb-c75c-4e17-8193-65f8a662e572,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333cb45e-2a, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:39 user nova-compute[70594]: INFO os_vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a')
Jul 26 17:17:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:17:39 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4281d734-eb87-4b5a-8618-7452e64119e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:17:39 user nova-compute[70594]: No targets found.
Jul 26 17:17:39 user nova-compute[70594]: iSNS:
Jul 26 17:17:39 user nova-compute[70594]: No targets found.
Jul 26 17:17:39 user nova-compute[70594]: STATIC:
Jul 26 17:17:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:17:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:17:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:17:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:17:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:17:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:17:39 user nova-compute[70594]: FIRMWARE:
Jul 26 17:17:39 user nova-compute[70594]: No targets found.
Jul 26 17:17:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:17:39 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:17:39 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fcfbd1-c32b-424d-a55d-f360c41eb982]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648ee9e-4427-4a56-8526-6dda2186e243]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:39 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:39 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:39 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:39 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:39 user nova-compute[70594]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:39 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59100f70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aece7e5-53e3-45d6-9dc0-086e1417408f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69cfb4d-116b-4be6-9dbb-8002aaf04e13]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d002ecf-8732-4ff3-815e-a1e399b8a7cf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce60db-e1ee-4feb-a023-fd1ae4a226e9]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1547c213-309f-470b-84a6-c63cba2ed0dc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef71be9-7e15-4ce6-9f20-b76ee4780b8c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]
Jul 26 17:17:39 user nova-compute[70594]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.
Jul 26 17:17:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c87ed0-72d0-406d-ab11-b10ceef1187b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== disconnect_volume: return (358ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:17:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Port 333cb45e-2afd-421e-bfbb-99c24655ba0d binding to destination host user is already ACTIVE {{(pid=70594) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquired lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:17:40 user nova-compute[70594]: DEBUG nova.network.neutron [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-008a5b7f-3920-4ccd-805d-c6d32aaf1355 req-afc91f6c-4fbe-488d-8f28-e2699bfab58c service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-008a5b7f-3920-4ccd-805d-c6d32aaf1355 req-afc91f6c-4fbe-488d-8f28-e2699bfab58c service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-008a5b7f-3920-4ccd-805d-c6d32aaf1355 req-afc91f6c-4fbe-488d-8f28-e2699bfab58c service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-008a5b7f-3920-4ccd-805d-c6d32aaf1355 req-afc91f6c-4fbe-488d-8f28-e2699bfab58c service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-008a5b7f-3920-4ccd-805d-c6d32aaf1355 req-afc91f6c-4fbe-488d-8f28-e2699bfab58c service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:41 user nova-compute[70594]: WARNING nova.compute.manager [req-008a5b7f-3920-4ccd-805d-c6d32aaf1355 req-afc91f6c-4fbe-488d-8f28-e2699bfab58c service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state active and task_state resize_migrated.
Jul 26 17:17:41 user nova-compute[70594]: DEBUG nova.network.neutron [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Releasing lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG os_brick.utils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2f76e3-4bd5-4200-b946-676ee6a86a1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0faff-2269-4e79-9e60-412db01e5504]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b725c67-fb84-4944-a8ca-29c20cc07281]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08550957-27ca-4fa0-99b3-32fc904f3100]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:17:41 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:17:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1a84b-32b1-4c75-8566-a16403616018]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:17:41 user nova-compute[70594]: DEBUG os_brick.utils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:17:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Starting finish_migration {{(pid=70594) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance directory exists: not creating {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 26 17:17:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Creating image(s)
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Ensure instance console log exists: /opt/stack/data/nova/instances/356f54bb-c75c-4e17-8193-65f8a662e572/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Start _get_guest_xml network_info=[{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '356f54bb-c75c-4e17-8193-65f8a662e572', 'attached_at': '2023-07-26T17:17:49.000000', 'detached_at': '', 'volume_id': '79a93153-6f28-454c-ac48-813c06647022', 'serial': '79a93153-6f28-454c-ac48-813c06647022'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '5b71895e-8628-44d9-a26c-1b988f78aabd', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:17:49 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:49 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.objects.instance [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:17:49 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:49 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:17:49 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[01887cca-1952-46fa-995f-b8407c587c3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:17:49 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea80261f-9dd4-4896-94b0-5f8fcf520473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022] added
Jul 26 17:17:49 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6906ea8-b811-4e78-8eda-03941d39a471]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d707c-6d3b-4961-bcc2-34de87f1bbf5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdhCZHLn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdhCZHLn" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff2464-1a89-4f31-8e23-21e5d6fd108d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdhCZHLn'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b82870-e586-44e2-8665-e489d04bbc2a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cbed57-4ec2-4d37-85a1-11919c0b84dd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:49 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:49 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:49 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:49 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:49 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:49 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --login" returned: 0 in 1.067s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99eb8ba-eec2-4c52-a107-4bdb6e3a90a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]
Jul 26 17:17:50 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.
Jul 26 17:17:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2819acca-2956-405a-9246-01858a783cec]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bd09a4-cad7-4e4a-a8ec-edb8f9ff8a6e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:50 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:50 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:17:50 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:17:50 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:17:50 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:17:50 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.287s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.039s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f2c7b-ce34-4b79-aa6f-562c3d0a784e]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:17:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:50 user nova-compute[70594]: INFO nova.compute.manager [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] instance snapshotting
Jul 26 17:17:50 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Beginning live snapshot process
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json -f qcow2 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu65fcpqv/86d523042bbd46a4ac65e1413b4dbf09.delta 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu65fcpqv/86d523042bbd46a4ac65e1413b4dbf09.delta 1073741824" returned: 0 in 0.049s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 26 17:17:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.346s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== connect_volume: return (2348ms) {'type': 'block', 'scsi_wwn': '23935656235323232', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935656235323232', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1398093165',display_name='tempest-ServerActionsTestOtherA-server-1398093165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1398093165',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-f8ds1v5x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=356f54bb-c75c-4e17-8193-65f8a662e572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:17:51 user nova-compute[70594]:   <uuid>356f54bb-c75c-4e17-8193-65f8a662e572</uuid>
Jul 26 17:17:51 user nova-compute[70594]:   <name>instance-00000026</name>
Jul 26 17:17:51 user nova-compute[70594]:   <memory>2097152</memory>
Jul 26 17:17:51 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:17:51 user nova-compute[70594]:   <metadata>
Jul 26 17:17:51 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:17:51 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:17:51 user nova-compute[70594]:       <nova:name>tempest-ServerActionsTestOtherA-server-1398093165</nova:name>
Jul 26 17:17:51 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:17:49</nova:creationTime>
Jul 26 17:17:51 user nova-compute[70594]:       <nova:flavor name="m1.small">
Jul 26 17:17:51 user nova-compute[70594]:         <nova:memory>2048</nova:memory>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:disk>20</nova:disk>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:17:51 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:17:51 user nova-compute[70594]:       <nova:owner>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:user uuid="feffa97fa65d4c2e963c6ef550377550">tempest-ServerActionsTestOtherA-1622849011-project-member</nova:user>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:project uuid="a4cf13ef41474309a9651baab74f6903">tempest-ServerActionsTestOtherA-1622849011</nova:project>
Jul 26 17:17:51 user nova-compute[70594]:       </nova:owner>
Jul 26 17:17:51 user nova-compute[70594]:       <nova:ports>
Jul 26 17:17:51 user nova-compute[70594]:         <nova:port uuid="333cb45e-2afd-421e-bfbb-99c24655ba0d">
Jul 26 17:17:51 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 26 17:17:51 user nova-compute[70594]:         </nova:port>
Jul 26 17:17:51 user nova-compute[70594]:       </nova:ports>
Jul 26 17:17:51 user nova-compute[70594]:     </nova:instance>
Jul 26 17:17:51 user nova-compute[70594]:   </metadata>
Jul 26 17:17:51 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:17:51 user nova-compute[70594]:     <system>
Jul 26 17:17:51 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:17:51 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:17:51 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:17:51 user nova-compute[70594]:       <entry name="serial">356f54bb-c75c-4e17-8193-65f8a662e572</entry>
Jul 26 17:17:51 user nova-compute[70594]:       <entry name="uuid">356f54bb-c75c-4e17-8193-65f8a662e572</entry>
Jul 26 17:17:51 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:17:51 user nova-compute[70594]:     </system>
Jul 26 17:17:51 user nova-compute[70594]:   </sysinfo>
Jul 26 17:17:51 user nova-compute[70594]:   <os>
Jul 26 17:17:51 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:17:51 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:17:51 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:17:51 user nova-compute[70594]:   </os>
Jul 26 17:17:51 user nova-compute[70594]:   <features>
Jul 26 17:17:51 user nova-compute[70594]:     <acpi/>
Jul 26 17:17:51 user nova-compute[70594]:     <apic/>
Jul 26 17:17:51 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:17:51 user nova-compute[70594]:   </features>
Jul 26 17:17:51 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:17:51 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:17:51 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:17:51 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:17:51 user nova-compute[70594]:   </clock>
Jul 26 17:17:51 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:17:51 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:17:51 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:17:51 user nova-compute[70594]:   </cpu>
Jul 26 17:17:51 user nova-compute[70594]:   <devices>
Jul 26 17:17:51 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:17:51 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:17:51 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:17:51 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:17:51 user nova-compute[70594]:       <serial>79a93153-6f28-454c-ac48-813c06647022</serial>
Jul 26 17:17:51 user nova-compute[70594]:     </disk>
Jul 26 17:17:51 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:17:51 user nova-compute[70594]:       <mac address="fa:16:3e:3b:0e:67"/>
Jul 26 17:17:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:17:51 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:17:51 user nova-compute[70594]:       <target dev="tap333cb45e-2a"/>
Jul 26 17:17:51 user nova-compute[70594]:     </interface>
Jul 26 17:17:51 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:17:51 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/356f54bb-c75c-4e17-8193-65f8a662e572/console.log" append="off"/>
Jul 26 17:17:51 user nova-compute[70594]:     </serial>
Jul 26 17:17:51 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:17:51 user nova-compute[70594]:     <video>
Jul 26 17:17:51 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:17:51 user nova-compute[70594]:     </video>
Jul 26 17:17:51 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:17:51 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:17:51 user nova-compute[70594]:     </rng>
Jul 26 17:17:51 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:17:51 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:17:51 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:17:51 user nova-compute[70594]:     </memballoon>
Jul 26 17:17:51 user nova-compute[70594]:   </devices>
Jul 26 17:17:51 user nova-compute[70594]: </domain>
Jul 26 17:17:51 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1398093165',display_name='tempest-ServerActionsTestOtherA-server-1398093165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1398093165',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-f8ds1v5x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=356f54bb-c75c-4e17-8193-65f8a662e572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-46833361-network", "vif_mac": "fa:16:3e:3b:0e:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG os_vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333cb45e-2a, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap333cb45e-2a, col_values=(('external_ids', {'iface-id': '333cb45e-2afd-421e-bfbb-99c24655ba0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:0e:67', 'vm-uuid': '356f54bb-c75c-4e17-8193-65f8a662e572'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:51 user nova-compute[70594]: INFO os_vif [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a')
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:17:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] No VIF found with MAC fa:16:3e:3b:0e:67, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:17:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:17:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70594) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 26 17:17:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 26 17:17:53 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu65fcpqv/86d523042bbd46a4ac65e1413b4dbf09.delta /opt/stack/data/nova/instances/snapshots/tmpu65fcpqv/86d523042bbd46a4ac65e1413b4dbf09 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu65fcpqv/86d523042bbd46a4ac65e1413b4dbf09.delta /opt/stack/data/nova/instances/snapshots/tmpu65fcpqv/86d523042bbd46a4ac65e1413b4dbf09" returned: 0 in 0.392s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:17:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Snapshot extracted, beginning image upload
Jul 26 17:17:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cb37de2-99a1-45d4-964e-a30726f91546 req-52289600-0413-4d4c-82b9-b0475ce18de0 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cb37de2-99a1-45d4-964e-a30726f91546 req-52289600-0413-4d4c-82b9-b0475ce18de0 service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cb37de2-99a1-45d4-964e-a30726f91546 req-52289600-0413-4d4c-82b9-b0475ce18de0 service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2cb37de2-99a1-45d4-964e-a30726f91546 req-52289600-0413-4d4c-82b9-b0475ce18de0 service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-2cb37de2-99a1-45d4-964e-a30726f91546 req-52289600-0413-4d4c-82b9-b0475ce18de0 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:53 user nova-compute[70594]: WARNING nova.compute.manager [req-2cb37de2-99a1-45d4-964e-a30726f91546 req-52289600-0413-4d4c-82b9-b0475ce18de0 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state active and task_state resize_finish.
Jul 26 17:17:54 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391859.3269877, 356f54bb-c75c-4e17-8193-65f8a662e572 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:54 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] VM Stopped (Lifecycle Event)
Jul 26 17:17:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-04e5a815-bbc9-4211-b243-ccd440c6ca3f None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:54 user nova-compute[70594]: INFO nova.compute.manager [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Terminating instance
Jul 26 17:17:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-54756c9f-a97d-442f-b5a8-43532ddb9d2f req-1c531188-1dee-4cc4-bdd5-0853c4667f09 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-vif-unplugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-54756c9f-a97d-442f-b5a8-43532ddb9d2f req-1c531188-1dee-4cc4-bdd5-0853c4667f09 service nova] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-54756c9f-a97d-442f-b5a8-43532ddb9d2f req-1c531188-1dee-4cc4-bdd5-0853c4667f09 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-54756c9f-a97d-442f-b5a8-43532ddb9d2f req-1c531188-1dee-4cc4-bdd5-0853c4667f09 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-54756c9f-a97d-442f-b5a8-43532ddb9d2f req-1c531188-1dee-4cc4-bdd5-0853c4667f09 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] No waiting events found dispatching network-vif-unplugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-54756c9f-a97d-442f-b5a8-43532ddb9d2f req-1c531188-1dee-4cc4-bdd5-0853c4667f09 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-vif-unplugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Instance destroyed successfully.
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'resources' on Instance uuid ea2e99b6-1db2-4669-9f88-17ddfebe3461 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-733384455',display_name='tempest-AttachVolumeNegativeTest-server-733384455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-733384455',id=37,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpXMATF8qQoXObgWZFyinXUjpYhCvt9XX6eJBPnSKoYo8Ubq9pt4404qYv7FmEXu8tVnPTuZfzBXN+bqGA8DWku3zeZPFqW+Yd9j58iaUL2Q7+23SEIxS2dm5Gyn3r8BQ==',key_name='tempest-keypair-1822468122',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:14:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-4xaj0x7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=ea2e99b6-1db2-4669-9f88-17ddfebe3461,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "address": "fa:16:3e:84:2c:5b", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b3ca80-e7", "ovs_interfaceid": "27b3ca80-e74a-479a-8846-e3bdc8a2bd33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG os_vif [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b3ca80-e7, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:17:55 user nova-compute[70594]: INFO os_vif [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b3ca80-e7')
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Deleting instance files /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461_del
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Deletion of /opt/stack/data/nova/instances/ea2e99b6-1db2-4669-9f88-17ddfebe3461_del complete
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.compute.manager [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 26 17:17:55 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391875.7565877, 356f54bb-c75c-4e17-8193-65f8a662e572 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] VM Resumed (Lifecycle Event)
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance running successfully.
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Failed to set time: agent not configured {{(pid=70594) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-07ee4181-7a99-4c4d-ac4f-0e3beb1aa440 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] finish_migration finished successfully. {{(pid=70594) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391875.7578425, 356f54bb-c75c-4e17-8193-65f8a662e572 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] VM Started (Lifecycle Event)
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-df783bec-27e8-4082-8074-f843c08c19fd req-0437f285-c0ab-4230-941c-c6dfcbe1724d service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-df783bec-27e8-4082-8074-f843c08c19fd req-0437f285-c0ab-4230-941c-c6dfcbe1724d service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-df783bec-27e8-4082-8074-f843c08c19fd req-0437f285-c0ab-4230-941c-c6dfcbe1724d service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-df783bec-27e8-4082-8074-f843c08c19fd req-0437f285-c0ab-4230-941c-c6dfcbe1724d service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-df783bec-27e8-4082-8074-f843c08c19fd req-0437f285-c0ab-4230-941c-c6dfcbe1724d service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:55 user nova-compute[70594]: WARNING nova.compute.manager [req-df783bec-27e8-4082-8074-f843c08c19fd req-0437f285-c0ab-4230-941c-c6dfcbe1724d service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state active and task_state resize_finish.
Jul 26 17:17:55 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 26 17:17:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:17:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Snapshot image upload complete
Jul 26 17:17:56 user nova-compute[70594]: INFO nova.compute.manager [None req-bcd5f6fa-b6e9-4bfd-881d-ecbfca3e70d9 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Took 5.68 seconds to snapshot the instance on the hypervisor.
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-4592f4ce-330c-4f8c-b470-95053b1b81f9 req-af2eba90-05f5-4a36-ab30-da9879ec8895 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4592f4ce-330c-4f8c-b470-95053b1b81f9 req-af2eba90-05f5-4a36-ab30-da9879ec8895 service nova] Acquiring lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4592f4ce-330c-4f8c-b470-95053b1b81f9 req-af2eba90-05f5-4a36-ab30-da9879ec8895 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-4592f4ce-330c-4f8c-b470-95053b1b81f9 req-af2eba90-05f5-4a36-ab30-da9879ec8895 service nova] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-4592f4ce-330c-4f8c-b470-95053b1b81f9 req-af2eba90-05f5-4a36-ab30-da9879ec8895 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] No waiting events found dispatching network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:17:57 user nova-compute[70594]: WARNING nova.compute.manager [req-4592f4ce-330c-4f8c-b470-95053b1b81f9 req-af2eba90-05f5-4a36-ab30-da9879ec8895 service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received unexpected event network-vif-plugged-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 for instance with vm_state active and task_state deleting.
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:57 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Took 1.66 seconds to deallocate network for instance.
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-6734eb02-1f11-44f8-a3ae-ebb1403f701e req-76accc5a-5ffd-4910-8b33-80716a988eef service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Received event network-vif-deleted-27b3ca80-e74a-479a-8846-e3bdc8a2bd33 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:17:57 user nova-compute[70594]: INFO nova.compute.manager [req-6734eb02-1f11-44f8-a3ae-ebb1403f701e req-76accc5a-5ffd-4910-8b33-80716a988eef service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Neutron deleted interface 27b3ca80-e74a-479a-8846-e3bdc8a2bd33; detaching it from the instance and deleting it from the info cache
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.network.neutron [req-6734eb02-1f11-44f8-a3ae-ebb1403f701e req-76accc5a-5ffd-4910-8b33-80716a988eef service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-6734eb02-1f11-44f8-a3ae-ebb1403f701e req-76accc5a-5ffd-4910-8b33-80716a988eef service nova] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Detach interface failed, port_id=27b3ca80-e74a-479a-8846-e3bdc8a2bd33, reason: Instance ea2e99b6-1db2-4669-9f88-17ddfebe3461 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:57 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Deleted allocations for instance ea2e99b6-1db2-4669-9f88-17ddfebe3461
Jul 26 17:17:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-e7c429cd-67e9-40d9-b946-05a50b12b5a9 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "ea2e99b6-1db2-4669-9f88-17ddfebe3461" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.298s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:17:59 user nova-compute[70594]: INFO nova.compute.claims [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Claim successful on node user
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:17:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.policy [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b7e2843bba8470eb36bd37c721c7972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef56c4a969bf4c7ea298d511ccda8490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:17:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Creating image(s)
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "/opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "/opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "/opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "0971103fb96d93e5e359206d38f9741a1ca5467e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:17:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "0971103fb96d93e5e359206d38f9741a1ca5467e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.part --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Successfully created port: f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:18:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.part --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG nova.virt.images [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] 553f6d35-dbb4-41a1-b76b-97d76b74a4a5 was qcow2, converting to raw {{(pid=70594) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG nova.privsep.utils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70594) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.part /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.converted {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.part /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.converted" returned: 0 in 0.272s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.converted --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "0971103fb96d93e5e359206d38f9741a1ca5467e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.585s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e --force-share --output=json" returned: 0 in 0.156s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "0971103fb96d93e5e359206d38f9741a1ca5467e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "0971103fb96d93e5e359206d38f9741a1ca5467e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e,backing_fmt=raw /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e,backing_fmt=raw /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk 1073741824" returned: 0 in 0.059s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "0971103fb96d93e5e359206d38f9741a1ca5467e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Successfully updated port: f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquired lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-changed-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Refreshing instance network info cache due to event network-changed-f2055bc6-97f4-44b4-80be-962a102a6668. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] Acquiring lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0971103fb96d93e5e359206d38f9741a1ca5467e --force-share --output=json" returned: 0 in 0.171s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'migration_context' on Instance uuid 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Ensure instance console log exists: /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.neutron [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updating instance_info_cache with network_info: [{"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Releasing lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Instance network_info: |[{"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] Acquired lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Refreshing network info cache for port f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Start _get_guest_xml network_info=[{"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='86833804c9c04baf2457ff237db9633e',container_format='bare',created_at=2023-07-26T17:17:51Z,direct_url=<?>,disk_format='qcow2',id=553f6d35-dbb4-41a1-b76b-97d76b74a4a5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1062135409',owner='ef56c4a969bf4c7ea298d511ccda8490',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-26T17:17:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '553f6d35-dbb4-41a1-b76b-97d76b74a4a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:18:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:02 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='86833804c9c04baf2457ff237db9633e',container_format='bare',created_at=2023-07-26T17:17:51Z,direct_url=<?>,disk_format='qcow2',id=553f6d35-dbb4-41a1-b76b-97d76b74a4a5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1062135409',owner='ef56c4a969bf4c7ea298d511ccda8490',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-26T17:17:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-262031580',display_name='tempest-TestStampPattern-server-262031580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-262031580',id=41,image_ref='553f6d35-dbb4-41a1-b76b-97d76b74a4a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuU9vkRiUUY91H5G4dksku7YGxgAoLoORaB/v72MwRrgyh8Fg/Vdg35Djak3dez1Rc5MS6C6T9oWoKIMJP3KiX73yatqrHOUDzXbKpDFoqQWisLjqlFn8Tb0pNMuGOcTA==',key_name='tempest-TestStampPattern-1443624212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef56c4a969bf4c7ea298d511ccda8490',ramdisk_id='',reservation_id='r-fl45yyha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e3deb93d-2ad8-45fa-91f1-68d48dea5637',image_min_disk='1',image_min_ram='0',image_owner_id='ef56c4a969bf4c7ea298d511ccda8490',image_owner_project_name='tempest-TestStampPattern-1856485652',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1856485652-project-member',image_user_id='1b7e2843bba8470eb36bd37c721c7972',network_allocated='True',owner_project_name='tempest-TestStampPattern-1856485652',owner_user_name='tempest-TestStampPattern-1856485652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:00Z,user_data=None,user_id='1b7e2843bba8470eb36bd37c721c7972',uuid=39b9457c-e7cd-46d2-99a1-8514560c6a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converting VIF {"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.objects.instance [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'pci_devices' on Instance uuid 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:18:02 user nova-compute[70594]:   <uuid>39b9457c-e7cd-46d2-99a1-8514560c6a02</uuid>
Jul 26 17:18:02 user nova-compute[70594]:   <name>instance-00000029</name>
Jul 26 17:18:02 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:18:02 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:18:02 user nova-compute[70594]:   <metadata>
Jul 26 17:18:02 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:18:02 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:18:02 user nova-compute[70594]:       <nova:name>tempest-TestStampPattern-server-262031580</nova:name>
Jul 26 17:18:02 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:18:02</nova:creationTime>
Jul 26 17:18:02 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:18:02 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:18:02 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:18:02 user nova-compute[70594]:       <nova:owner>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:user uuid="1b7e2843bba8470eb36bd37c721c7972">tempest-TestStampPattern-1856485652-project-member</nova:user>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:project uuid="ef56c4a969bf4c7ea298d511ccda8490">tempest-TestStampPattern-1856485652</nova:project>
Jul 26 17:18:02 user nova-compute[70594]:       </nova:owner>
Jul 26 17:18:02 user nova-compute[70594]:       <nova:root type="image" uuid="553f6d35-dbb4-41a1-b76b-97d76b74a4a5"/>
Jul 26 17:18:02 user nova-compute[70594]:       <nova:ports>
Jul 26 17:18:02 user nova-compute[70594]:         <nova:port uuid="f2055bc6-97f4-44b4-80be-962a102a6668">
Jul 26 17:18:02 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:18:02 user nova-compute[70594]:         </nova:port>
Jul 26 17:18:02 user nova-compute[70594]:       </nova:ports>
Jul 26 17:18:02 user nova-compute[70594]:     </nova:instance>
Jul 26 17:18:02 user nova-compute[70594]:   </metadata>
Jul 26 17:18:02 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:18:02 user nova-compute[70594]:     <system>
Jul 26 17:18:02 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:18:02 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:18:02 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:18:02 user nova-compute[70594]:       <entry name="serial">39b9457c-e7cd-46d2-99a1-8514560c6a02</entry>
Jul 26 17:18:02 user nova-compute[70594]:       <entry name="uuid">39b9457c-e7cd-46d2-99a1-8514560c6a02</entry>
Jul 26 17:18:02 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:18:02 user nova-compute[70594]:     </system>
Jul 26 17:18:02 user nova-compute[70594]:   </sysinfo>
Jul 26 17:18:02 user nova-compute[70594]:   <os>
Jul 26 17:18:02 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:18:02 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:18:02 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:18:02 user nova-compute[70594]:   </os>
Jul 26 17:18:02 user nova-compute[70594]:   <features>
Jul 26 17:18:02 user nova-compute[70594]:     <acpi/>
Jul 26 17:18:02 user nova-compute[70594]:     <apic/>
Jul 26 17:18:02 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:18:02 user nova-compute[70594]:   </features>
Jul 26 17:18:02 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:18:02 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:18:02 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:18:02 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:18:02 user nova-compute[70594]:   </clock>
Jul 26 17:18:02 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:18:02 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:18:02 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:18:02 user nova-compute[70594]:   </cpu>
Jul 26 17:18:02 user nova-compute[70594]:   <devices>
Jul 26 17:18:02 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:18:02 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:18:02 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk"/>
Jul 26 17:18:02 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:18:02 user nova-compute[70594]:     </disk>
Jul 26 17:18:02 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:18:02 user nova-compute[70594]:       <mac address="fa:16:3e:51:98:df"/>
Jul 26 17:18:02 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:18:02 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:18:02 user nova-compute[70594]:       <target dev="tapf2055bc6-97"/>
Jul 26 17:18:02 user nova-compute[70594]:     </interface>
Jul 26 17:18:02 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:18:02 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/console.log" append="off"/>
Jul 26 17:18:02 user nova-compute[70594]:     </serial>
Jul 26 17:18:02 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:18:02 user nova-compute[70594]:     <video>
Jul 26 17:18:02 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:18:02 user nova-compute[70594]:     </video>
Jul 26 17:18:02 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:18:02 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:18:02 user nova-compute[70594]:     </rng>
Jul 26 17:18:02 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:18:02 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:18:02 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:18:02 user nova-compute[70594]:     </memballoon>
Jul 26 17:18:02 user nova-compute[70594]:   </devices>
Jul 26 17:18:02 user nova-compute[70594]: </domain>
Jul 26 17:18:02 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-262031580',display_name='tempest-TestStampPattern-server-262031580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-262031580',id=41,image_ref='553f6d35-dbb4-41a1-b76b-97d76b74a4a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuU9vkRiUUY91H5G4dksku7YGxgAoLoORaB/v72MwRrgyh8Fg/Vdg35Djak3dez1Rc5MS6C6T9oWoKIMJP3KiX73yatqrHOUDzXbKpDFoqQWisLjqlFn8Tb0pNMuGOcTA==',key_name='tempest-TestStampPattern-1443624212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef56c4a969bf4c7ea298d511ccda8490',ramdisk_id='',reservation_id='r-fl45yyha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e3deb93d-2ad8-45fa-91f1-68d48dea5637',image_min_disk='1',image_min_ram='0',image_owner_id='ef56c4a969bf4c7ea298d511ccda8490',image_owner_project_name='tempest-TestStampPattern-1856485652',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1856485652-project-member',image_user_id='1b7e2843bba8470eb36bd37c721c7972',network_allocated='True',owner_project_name='tempest-TestStampPattern-1856485652',owner_user_name='tempest-TestStampPattern-1856485652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:00Z,user_data=None,user_id='1b7e2843bba8470eb36bd37c721c7972',uuid=39b9457c-e7cd-46d2-99a1-8514560c6a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converting VIF {"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG os_vif [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2055bc6-97, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2055bc6-97, col_values=(('external_ids', {'iface-id': 'f2055bc6-97f4-44b4-80be-962a102a6668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:98:df', 'vm-uuid': '39b9457c-e7cd-46d2-99a1-8514560c6a02'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:02 user nova-compute[70594]: INFO os_vif [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97')
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No VIF found with MAC fa:16:3e:51:98:df, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updated VIF entry in instance network info cache for port f2055bc6-97f4-44b4-80be-962a102a6668. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG nova.network.neutron [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updating instance_info_cache with network_info: [{"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3fd4c843-d726-4d52-9620-0752a1654534 req-ea448de0-1173-41e4-b5e5-8d3da7456562 service nova] Releasing lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG nova.compute.manager [req-a51ce683-a409-49ad-84d2-67c429bb75a0 req-1168a759-9074-4f95-a752-89523f9dd989 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a51ce683-a409-49ad-84d2-67c429bb75a0 req-1168a759-9074-4f95-a752-89523f9dd989 service nova] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a51ce683-a409-49ad-84d2-67c429bb75a0 req-1168a759-9074-4f95-a752-89523f9dd989 service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a51ce683-a409-49ad-84d2-67c429bb75a0 req-1168a759-9074-4f95-a752-89523f9dd989 service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:04 user nova-compute[70594]: DEBUG nova.compute.manager [req-a51ce683-a409-49ad-84d2-67c429bb75a0 req-1168a759-9074-4f95-a752-89523f9dd989 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] No waiting events found dispatching network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:04 user nova-compute[70594]: WARNING nova.compute.manager [req-a51ce683-a409-49ad-84d2-67c429bb75a0 req-1168a759-9074-4f95-a752-89523f9dd989 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received unexpected event network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 for instance with vm_state building and task_state spawning.
Jul 26 17:18:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391886.1492336, 39b9457c-e7cd-46d2-99a1-8514560c6a02 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] VM Resumed (Lifecycle Event)
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Instance spawned successfully.
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391886.1529593, 39b9457c-e7cd-46d2-99a1-8514560c6a02 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] VM Started (Lifecycle Event)
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Took 6.42 seconds to spawn the instance on the hypervisor.
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-a1a238a4-f723-4595-992c-30ce1e9462d9 req-58dcfb07-385b-4fb3-aebf-d4432b8170bf service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a1a238a4-f723-4595-992c-30ce1e9462d9 req-58dcfb07-385b-4fb3-aebf-d4432b8170bf service nova] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a1a238a4-f723-4595-992c-30ce1e9462d9 req-58dcfb07-385b-4fb3-aebf-d4432b8170bf service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a1a238a4-f723-4595-992c-30ce1e9462d9 req-58dcfb07-385b-4fb3-aebf-d4432b8170bf service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-a1a238a4-f723-4595-992c-30ce1e9462d9 req-58dcfb07-385b-4fb3-aebf-d4432b8170bf service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] No waiting events found dispatching network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:06 user nova-compute[70594]: WARNING nova.compute.manager [req-a1a238a4-f723-4595-992c-30ce1e9462d9 req-58dcfb07-385b-4fb3-aebf-d4432b8170bf service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received unexpected event network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 for instance with vm_state building and task_state spawning.
Jul 26 17:18:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:06 user nova-compute[70594]: INFO nova.compute.manager [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Took 7.53 seconds to build instance.
Jul 26 17:18:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-fa98d07a-7d23-4996-8ceb-afee859208e7 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.671s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:08 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:09 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:18:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:09 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:09 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:18:09 user nova-compute[70594]: INFO nova.compute.claims [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Claim successful on node user
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:18:10 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.policy [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8c2f0388cd44ee0a70d339848c959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b13118c340f4eaabfbdc079710d7f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:18:10 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Creating image(s)
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "/opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "/opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391875.3404338, ea2e99b6-1db2-4669-9f88-17ddfebe3461 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:10 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] VM Stopped (Lifecycle Event)
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f1959922-4003-44ae-a143-67429b772ca2 None None] [instance: ea2e99b6-1db2-4669-9f88-17ddfebe3461] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk 1073741824" returned: 0 in 0.054s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Cannot resize image /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lazy-loading 'migration_context' on Instance uuid 6d000228-a585-4c95-af6d-d9b2d8b35993 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Ensure instance console log exists: /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:10 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Successfully created port: 42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Successfully updated port: 42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "refresh_cache-6d000228-a585-4c95-af6d-d9b2d8b35993" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquired lock "refresh_cache-6d000228-a585-4c95-af6d-d9b2d8b35993" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-changed-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG nova.compute.manager [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Refreshing instance network info cache due to event network-changed-42b20275-f53b-46bf-8c3d-4d47bc447fbd. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] Acquiring lock "refresh_cache-6d000228-a585-4c95-af6d-d9b2d8b35993" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:11 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Updating instance_info_cache with network_info: [{"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Releasing lock "refresh_cache-6d000228-a585-4c95-af6d-d9b2d8b35993" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Instance network_info: |[{"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] Acquired lock "refresh_cache-6d000228-a585-4c95-af6d-d9b2d8b35993" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Refreshing network info cache for port 42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Start _get_guest_xml network_info=[{"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:18:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:12 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-858073640',display_name='tempest-VolumesActionsTest-instance-858073640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-858073640',id=42,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b13118c340f4eaabfbdc079710d7f4b',ramdisk_id='',reservation_id='r-5i6tevhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-498904371',owner_user_name='tempest-VolumesActionsTest-498904371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:10Z,user_data=None,user_id='f8c2f0388cd44ee0a70d339848c959ce',uuid=6d000228-a585-4c95-af6d-d9b2d8b35993,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converting VIF {"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d000228-a585-4c95-af6d-d9b2d8b35993 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:18:12 user nova-compute[70594]:   <uuid>6d000228-a585-4c95-af6d-d9b2d8b35993</uuid>
Jul 26 17:18:12 user nova-compute[70594]:   <name>instance-0000002a</name>
Jul 26 17:18:12 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:18:12 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:18:12 user nova-compute[70594]:   <metadata>
Jul 26 17:18:12 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:18:12 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:18:12 user nova-compute[70594]:       <nova:name>tempest-VolumesActionsTest-instance-858073640</nova:name>
Jul 26 17:18:12 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:18:12</nova:creationTime>
Jul 26 17:18:12 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:18:12 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:18:12 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:18:12 user nova-compute[70594]:       <nova:owner>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:user uuid="f8c2f0388cd44ee0a70d339848c959ce">tempest-VolumesActionsTest-498904371-project-member</nova:user>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:project uuid="9b13118c340f4eaabfbdc079710d7f4b">tempest-VolumesActionsTest-498904371</nova:project>
Jul 26 17:18:12 user nova-compute[70594]:       </nova:owner>
Jul 26 17:18:12 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:18:12 user nova-compute[70594]:       <nova:ports>
Jul 26 17:18:12 user nova-compute[70594]:         <nova:port uuid="42b20275-f53b-46bf-8c3d-4d47bc447fbd">
Jul 26 17:18:12 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 26 17:18:12 user nova-compute[70594]:         </nova:port>
Jul 26 17:18:12 user nova-compute[70594]:       </nova:ports>
Jul 26 17:18:12 user nova-compute[70594]:     </nova:instance>
Jul 26 17:18:12 user nova-compute[70594]:   </metadata>
Jul 26 17:18:12 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:18:12 user nova-compute[70594]:     <system>
Jul 26 17:18:12 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:18:12 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:18:12 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:18:12 user nova-compute[70594]:       <entry name="serial">6d000228-a585-4c95-af6d-d9b2d8b35993</entry>
Jul 26 17:18:12 user nova-compute[70594]:       <entry name="uuid">6d000228-a585-4c95-af6d-d9b2d8b35993</entry>
Jul 26 17:18:12 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:18:12 user nova-compute[70594]:     </system>
Jul 26 17:18:12 user nova-compute[70594]:   </sysinfo>
Jul 26 17:18:12 user nova-compute[70594]:   <os>
Jul 26 17:18:12 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:18:12 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:18:12 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:18:12 user nova-compute[70594]:   </os>
Jul 26 17:18:12 user nova-compute[70594]:   <features>
Jul 26 17:18:12 user nova-compute[70594]:     <acpi/>
Jul 26 17:18:12 user nova-compute[70594]:     <apic/>
Jul 26 17:18:12 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:18:12 user nova-compute[70594]:   </features>
Jul 26 17:18:12 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:18:12 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:18:12 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:18:12 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:18:12 user nova-compute[70594]:   </clock>
Jul 26 17:18:12 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:18:12 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:18:12 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:18:12 user nova-compute[70594]:   </cpu>
Jul 26 17:18:12 user nova-compute[70594]:   <devices>
Jul 26 17:18:12 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:18:12 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:18:12 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk"/>
Jul 26 17:18:12 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:18:12 user nova-compute[70594]:     </disk>
Jul 26 17:18:12 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:18:12 user nova-compute[70594]:       <mac address="fa:16:3e:94:b5:4b"/>
Jul 26 17:18:12 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:18:12 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:18:12 user nova-compute[70594]:       <target dev="tap42b20275-f5"/>
Jul 26 17:18:12 user nova-compute[70594]:     </interface>
Jul 26 17:18:12 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:18:12 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/console.log" append="off"/>
Jul 26 17:18:12 user nova-compute[70594]:     </serial>
Jul 26 17:18:12 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:18:12 user nova-compute[70594]:     <video>
Jul 26 17:18:12 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:18:12 user nova-compute[70594]:     </video>
Jul 26 17:18:12 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:18:12 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:18:12 user nova-compute[70594]:     </rng>
Jul 26 17:18:12 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:18:12 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:18:12 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:18:12 user nova-compute[70594]:     </memballoon>
Jul 26 17:18:12 user nova-compute[70594]:   </devices>
Jul 26 17:18:12 user nova-compute[70594]: </domain>
Jul 26 17:18:12 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-858073640',display_name='tempest-VolumesActionsTest-instance-858073640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-858073640',id=42,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b13118c340f4eaabfbdc079710d7f4b',ramdisk_id='',reservation_id='r-5i6tevhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-498904371',owner_user_name='tempest-VolumesActionsTest-498904371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:10Z,user_data=None,user_id='f8c2f0388cd44ee0a70d339848c959ce',uuid=6d000228-a585-4c95-af6d-d9b2d8b35993,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converting VIF {"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG os_vif [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b20275-f5, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42b20275-f5, col_values=(('external_ids', {'iface-id': '42b20275-f53b-46bf-8c3d-4d47bc447fbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:b5:4b', 'vm-uuid': '6d000228-a585-4c95-af6d-d9b2d8b35993'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:12 user nova-compute[70594]: INFO os_vif [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5')
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] No VIF found with MAC fa:16:3e:94:b5:4b, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Updated VIF entry in instance network info cache for port 42b20275-f53b-46bf-8c3d-4d47bc447fbd. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG nova.network.neutron [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Updating instance_info_cache with network_info: [{"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-55452811-8ce1-4ba9-a16f-90da37159d24 req-7fd5c562-6c7d-4415-9448-4c6371670bad service nova] Releasing lock "refresh_cache-6d000228-a585-4c95-af6d-d9b2d8b35993" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-65ffb105-45f9-47cd-90be-3d8219bac9ad req-4107809f-36a6-443f-ada5-6486b0c43711 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-65ffb105-45f9-47cd-90be-3d8219bac9ad req-4107809f-36a6-443f-ada5-6486b0c43711 service nova] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-65ffb105-45f9-47cd-90be-3d8219bac9ad req-4107809f-36a6-443f-ada5-6486b0c43711 service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-65ffb105-45f9-47cd-90be-3d8219bac9ad req-4107809f-36a6-443f-ada5-6486b0c43711 service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-65ffb105-45f9-47cd-90be-3d8219bac9ad req-4107809f-36a6-443f-ada5-6486b0c43711 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] No waiting events found dispatching network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:14 user nova-compute[70594]: WARNING nova.compute.manager [req-65ffb105-45f9-47cd-90be-3d8219bac9ad req-4107809f-36a6-443f-ada5-6486b0c43711 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received unexpected event network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd for instance with vm_state building and task_state spawning.
Jul 26 17:18:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:14 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391895.8063703, 6d000228-a585-4c95-af6d-d9b2d8b35993 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:15 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] VM Resumed (Lifecycle Event)
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:18:15 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Instance spawned successfully.
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:15 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391895.8079515, 6d000228-a585-4c95-af6d-d9b2d8b35993 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:15 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] VM Started (Lifecycle Event)
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:18:15 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:15 user nova-compute[70594]: INFO nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Took 5.72 seconds to spawn the instance on the hypervisor.
Jul 26 17:18:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:16 user nova-compute[70594]: INFO nova.compute.manager [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Took 6.61 seconds to build instance.
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7e51c30b-9eff-4b06-bb73-dd92b9115c2c tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.708s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ddc75a3-da2f-44db-8e91-805e10c5d8ac req-6fe96297-8960-4856-8c44-aa6e8cf00ad2 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ddc75a3-da2f-44db-8e91-805e10c5d8ac req-6fe96297-8960-4856-8c44-aa6e8cf00ad2 service nova] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ddc75a3-da2f-44db-8e91-805e10c5d8ac req-6fe96297-8960-4856-8c44-aa6e8cf00ad2 service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2ddc75a3-da2f-44db-8e91-805e10c5d8ac req-6fe96297-8960-4856-8c44-aa6e8cf00ad2 service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-2ddc75a3-da2f-44db-8e91-805e10c5d8ac req-6fe96297-8960-4856-8c44-aa6e8cf00ad2 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] No waiting events found dispatching network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:16 user nova-compute[70594]: WARNING nova.compute.manager [req-2ddc75a3-da2f-44db-8e91-805e10c5d8ac req-6fe96297-8960-4856-8c44-aa6e8cf00ad2 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received unexpected event network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd for instance with vm_state active and task_state None.
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:18:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:17 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:17 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=24.966964721679688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Applying migration context for instance 356f54bb-c75c-4e17-8193-65f8a662e572 as it has an incoming, in-progress migration dd4ae860-67e8-4491-a24e-bb74e44fef57. Migration status is finished {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:987}}
Jul 26 17:18:17 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating resource usage from migration dd4ae860-67e8-4491-a24e-bb74e44fef57
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 70df069f-5f6c-4463-aa0d-4a323de18b10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 808c3361-0697-42f4-bea3-5107c614ef0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Migration dd4ae860-67e8-4491-a24e-bb74e44fef57 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1674}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6d000228-a585-4c95-af6d-d9b2d8b35993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:18:17 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:18:18 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:18:18 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:18:18 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:18:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:18:19 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:18:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:18:20 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Updating instance_info_cache with network_info: [{"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:18:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:27 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:33 user nova-compute[70594]: INFO nova.compute.manager [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Terminating instance
Jul 26 17:18:33 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d84f7f7-763a-4e32-8e22-3a21dc1b9f30 req-fe239cbf-6553-4031-b2fb-900cea3ca489 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d84f7f7-763a-4e32-8e22-3a21dc1b9f30 req-fe239cbf-6553-4031-b2fb-900cea3ca489 service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d84f7f7-763a-4e32-8e22-3a21dc1b9f30 req-fe239cbf-6553-4031-b2fb-900cea3ca489 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3d84f7f7-763a-4e32-8e22-3a21dc1b9f30 req-fe239cbf-6553-4031-b2fb-900cea3ca489 service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d84f7f7-763a-4e32-8e22-3a21dc1b9f30 req-fe239cbf-6553-4031-b2fb-900cea3ca489 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-3d84f7f7-763a-4e32-8e22-3a21dc1b9f30 req-fe239cbf-6553-4031-b2fb-900cea3ca489 service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-unplugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:34 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Instance destroyed successfully.
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'resources' on Instance uuid aa0cbb71-bab6-4f6a-afa1-24c26c851f9f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-571158116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-571158116',id=34,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-7dvuw2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:16:47Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=aa0cbb71-bab6-4f6a-afa1-24c26c851f9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "96fad621-8fa0-44df-af0b-0d07cbad2013", "address": "fa:16:3e:d0:76:ac", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96fad621-8f", "ovs_interfaceid": "96fad621-8fa0-44df-af0b-0d07cbad2013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_vif [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96fad621-8f, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:34 user nova-compute[70594]: INFO os_vif [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:76:ac,bridge_name='br-int',has_traffic_filtering=True,id=96fad621-8fa0-44df-af0b-0d07cbad2013,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96fad621-8f')
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGYnOpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:18:34 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b42ad3-914a-419c-8ff0-3eb68b5d073f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:18:34 user nova-compute[70594]: No targets found.
Jul 26 17:18:34 user nova-compute[70594]: iSNS:
Jul 26 17:18:34 user nova-compute[70594]: No targets found.
Jul 26 17:18:34 user nova-compute[70594]: STATIC:
Jul 26 17:18:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af
Jul 26 17:18:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:18:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:18:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:18:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:18:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:18:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:18:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:18:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:18:34 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:18:34 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:18:34 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:18:34 user nova-compute[70594]: FIRMWARE:
Jul 26 17:18:34 user nova-compute[70594]: No targets found.
Jul 26 17:18:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:18:34 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:18:34 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8201331-8680-4971-a36a-667883b96ffb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c159aa85-bd78-4085-8612-e1ca99745be7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:18:34 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:18:34 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:18:34 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:18:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:18:34 user nova-compute[70594]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af (non-flash)
Jul 26 17:18:34 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:18:34 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:18:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591830fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5564acf-b242-4bca-b42a-5f27309f2b12]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1bdbbc-0ec5-4e7b-9022-b0b4c57bce19]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e02680-2a61-4938-9a2b-149d5d4503f8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca71d288-8f5d-4407-ad70-3b520d0e3a14]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6a5d467b-4a2da7781ea9c0c0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6a5d467b', '/dev/disk/by-id/scsi-23461326461373738') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[59103586-ad6c-486e-8172-90f03e569917]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32be5b1b-dbd4-47ab-80b8-0e6b04a18ac2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634096a-1c22-4e97-8fec-bf25efe90994]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260]
Jul 26 17:18:34 user nova-compute[70594]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af, portal: 172.16.0.220,3260] successful.
Jul 26 17:18:34 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba580e59-b834-4cd1-99e8-48693d0ed8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8412d-0942-41c3-87e8-1ce2b894a8e1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== disconnect_volume: return (350ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:18:34 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Deleting instance files /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f_del
Jul 26 17:18:34 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Deletion of /opt/stack/data/nova/instances/aa0cbb71-bab6-4f6a-afa1-24c26c851f9f_del complete
Jul 26 17:18:34 user nova-compute[70594]: INFO nova.compute.manager [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 26 17:18:34 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:18:34 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:35 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Took 0.49 seconds to deallocate network for instance.
Jul 26 17:18:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-49128267-cc40-4a76-8e9d-37ca75091cca req-f6932da6-a8c1-43b4-b606-17aee25e33be service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-deleted-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:35 user nova-compute[70594]: INFO nova.compute.manager [req-49128267-cc40-4a76-8e9d-37ca75091cca req-f6932da6-a8c1-43b4-b606-17aee25e33be service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Neutron deleted interface 96fad621-8fa0-44df-af0b-0d07cbad2013; detaching it from the instance and deleting it from the info cache
Jul 26 17:18:35 user nova-compute[70594]: DEBUG nova.network.neutron [req-49128267-cc40-4a76-8e9d-37ca75091cca req-f6932da6-a8c1-43b4-b606-17aee25e33be service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-49128267-cc40-4a76-8e9d-37ca75091cca req-f6932da6-a8c1-43b4-b606-17aee25e33be service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Detach interface failed, port_id=96fad621-8fa0-44df-af0b-0d07cbad2013, reason: Instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-a4b71663-cdea-485d-a84e-74a0bc1ad2f1 req-55d306fa-c6fb-4611-950e-2cf322bd2d3f service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a4b71663-cdea-485d-a84e-74a0bc1ad2f1 req-55d306fa-c6fb-4611-950e-2cf322bd2d3f service nova] Acquiring lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a4b71663-cdea-485d-a84e-74a0bc1ad2f1 req-55d306fa-c6fb-4611-950e-2cf322bd2d3f service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a4b71663-cdea-485d-a84e-74a0bc1ad2f1 req-55d306fa-c6fb-4611-950e-2cf322bd2d3f service nova] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-a4b71663-cdea-485d-a84e-74a0bc1ad2f1 req-55d306fa-c6fb-4611-950e-2cf322bd2d3f service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] No waiting events found dispatching network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:35 user nova-compute[70594]: WARNING nova.compute.manager [req-a4b71663-cdea-485d-a84e-74a0bc1ad2f1 req-55d306fa-c6fb-4611-950e-2cf322bd2d3f service nova] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Received unexpected event network-vif-plugged-96fad621-8fa0-44df-af0b-0d07cbad2013 for instance with vm_state active and task_state deleting.
Jul 26 17:18:35 user nova-compute[70594]: INFO nova.compute.manager [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Took 0.78 seconds to detach 1 volumes for instance.
Jul 26 17:18:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:36 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:18:36 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:18:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:36 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Deleted allocations for instance aa0cbb71-bab6-4f6a-afa1-24c26c851f9f
Jul 26 17:18:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a8bfaf7f-a15e-4227-b82c-a7a04bbd40cd tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "aa0cbb71-bab6-4f6a-afa1-24c26c851f9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.055s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:18:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:48 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:18:48 user nova-compute[70594]: INFO nova.compute.claims [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Claim successful on node user
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391914.1255217, aa0cbb71-bab6-4f6a-afa1-24c26c851f9f => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:49 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] VM Stopped (Lifecycle Event)
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c9b96981-608f-4bc6-bf75-2ff70d7c5eb7 None None] [instance: aa0cbb71-bab6-4f6a-afa1-24c26c851f9f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-changed-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Refreshing instance network info cache due to event network-changed-ebd10397-3239-4b56-a47b-5e53ec0ac80d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] Acquiring lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] Acquired lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Refreshing network info cache for port ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:18:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:18:49 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Creating image(s)
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "/opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "/opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG nova.policy [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7389a1c933cc4c24b20281842b82e83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b689bf7a7c5049dbac0edae98843930c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.152s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk 1073741824" returned: 0 in 0.049s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Cannot resize image /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'migration_context' on Instance uuid 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Ensure instance console log exists: /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updated VIF entry in instance network info cache for port ebd10397-3239-4b56-a47b-5e53ec0ac80d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updating instance_info_cache with network_info: [{"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-27dc511e-add8-41a0-ab0b-cc2906d47a28 req-a4ccc924-2e5c-4e10-b60f-c2282e77b286 service nova] Releasing lock "refresh_cache-70df069f-5f6c-4463-aa0d-4a323de18b10" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Successfully created port: 26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Successfully updated port: 26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquired lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-changed-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Refreshing instance network info cache due to event network-changed-26a83df4-786b-458d-9db2-e73bf9e07d71. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] Acquiring lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:18:51 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updating instance_info_cache with network_info: [{"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Releasing lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Instance network_info: |[{"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] Acquired lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Refreshing network info cache for port 26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Start _get_guest_xml network_info=[{"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:18:52 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:52 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-215846485',display_name='tempest-AttachVolumeNegativeTest-server-215846485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-215846485',id=43,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdB9XpCfrAYp86giPnS11HriHgEVNAJN3FWoGDdCVbn9kM6Fvip7e/QDzRvqYnO3iMV3ufPrSnAtMOdSgwWpapFd1Pxz+k/RBt/GJ6b3QCcpPLG+9HOoI3VgZbp2iNBUw==',key_name='tempest-keypair-1131839349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-1sne5ba7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=08bc58e4-d6b2-493a-9d0f-ff43546997bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'pci_devices' on Instance uuid 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:18:52 user nova-compute[70594]:   <uuid>08bc58e4-d6b2-493a-9d0f-ff43546997bc</uuid>
Jul 26 17:18:52 user nova-compute[70594]:   <name>instance-0000002b</name>
Jul 26 17:18:52 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:18:52 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:18:52 user nova-compute[70594]:   <metadata>
Jul 26 17:18:52 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:18:52 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:18:52 user nova-compute[70594]:       <nova:name>tempest-AttachVolumeNegativeTest-server-215846485</nova:name>
Jul 26 17:18:52 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:18:52</nova:creationTime>
Jul 26 17:18:52 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:18:52 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:18:52 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:18:52 user nova-compute[70594]:       <nova:owner>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:user uuid="7389a1c933cc4c24b20281842b82e83b">tempest-AttachVolumeNegativeTest-1151062115-project-member</nova:user>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:project uuid="b689bf7a7c5049dbac0edae98843930c">tempest-AttachVolumeNegativeTest-1151062115</nova:project>
Jul 26 17:18:52 user nova-compute[70594]:       </nova:owner>
Jul 26 17:18:52 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:18:52 user nova-compute[70594]:       <nova:ports>
Jul 26 17:18:52 user nova-compute[70594]:         <nova:port uuid="26a83df4-786b-458d-9db2-e73bf9e07d71">
Jul 26 17:18:52 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 26 17:18:52 user nova-compute[70594]:         </nova:port>
Jul 26 17:18:52 user nova-compute[70594]:       </nova:ports>
Jul 26 17:18:52 user nova-compute[70594]:     </nova:instance>
Jul 26 17:18:52 user nova-compute[70594]:   </metadata>
Jul 26 17:18:52 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:18:52 user nova-compute[70594]:     <system>
Jul 26 17:18:52 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:18:52 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:18:52 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:18:52 user nova-compute[70594]:       <entry name="serial">08bc58e4-d6b2-493a-9d0f-ff43546997bc</entry>
Jul 26 17:18:52 user nova-compute[70594]:       <entry name="uuid">08bc58e4-d6b2-493a-9d0f-ff43546997bc</entry>
Jul 26 17:18:52 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:18:52 user nova-compute[70594]:     </system>
Jul 26 17:18:52 user nova-compute[70594]:   </sysinfo>
Jul 26 17:18:52 user nova-compute[70594]:   <os>
Jul 26 17:18:52 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:18:52 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:18:52 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:18:52 user nova-compute[70594]:   </os>
Jul 26 17:18:52 user nova-compute[70594]:   <features>
Jul 26 17:18:52 user nova-compute[70594]:     <acpi/>
Jul 26 17:18:52 user nova-compute[70594]:     <apic/>
Jul 26 17:18:52 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:18:52 user nova-compute[70594]:   </features>
Jul 26 17:18:52 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:18:52 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:18:52 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:18:52 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:18:52 user nova-compute[70594]:   </clock>
Jul 26 17:18:52 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:18:52 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:18:52 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:18:52 user nova-compute[70594]:   </cpu>
Jul 26 17:18:52 user nova-compute[70594]:   <devices>
Jul 26 17:18:52 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:18:52 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:18:52 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk"/>
Jul 26 17:18:52 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:18:52 user nova-compute[70594]:     </disk>
Jul 26 17:18:52 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:18:52 user nova-compute[70594]:       <mac address="fa:16:3e:5f:0f:ac"/>
Jul 26 17:18:52 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:18:52 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:18:52 user nova-compute[70594]:       <target dev="tap26a83df4-78"/>
Jul 26 17:18:52 user nova-compute[70594]:     </interface>
Jul 26 17:18:52 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:18:52 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/console.log" append="off"/>
Jul 26 17:18:52 user nova-compute[70594]:     </serial>
Jul 26 17:18:52 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:18:52 user nova-compute[70594]:     <video>
Jul 26 17:18:52 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:18:52 user nova-compute[70594]:     </video>
Jul 26 17:18:52 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:18:52 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:18:52 user nova-compute[70594]:     </rng>
Jul 26 17:18:52 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:18:52 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:18:52 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:18:52 user nova-compute[70594]:     </memballoon>
Jul 26 17:18:52 user nova-compute[70594]:   </devices>
Jul 26 17:18:52 user nova-compute[70594]: </domain>
Jul 26 17:18:52 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-215846485',display_name='tempest-AttachVolumeNegativeTest-server-215846485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-215846485',id=43,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdB9XpCfrAYp86giPnS11HriHgEVNAJN3FWoGDdCVbn9kM6Fvip7e/QDzRvqYnO3iMV3ufPrSnAtMOdSgwWpapFd1Pxz+k/RBt/GJ6b3QCcpPLG+9HOoI3VgZbp2iNBUw==',key_name='tempest-keypair-1131839349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-1sne5ba7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=08bc58e4-d6b2-493a-9d0f-ff43546997bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG os_vif [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26a83df4-78, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26a83df4-78, col_values=(('external_ids', {'iface-id': '26a83df4-786b-458d-9db2-e73bf9e07d71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:0f:ac', 'vm-uuid': '08bc58e4-d6b2-493a-9d0f-ff43546997bc'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:52 user nova-compute[70594]: INFO os_vif [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78')
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:5f:0f:ac, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updated VIF entry in instance network info cache for port 26a83df4-786b-458d-9db2-e73bf9e07d71. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG nova.network.neutron [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updating instance_info_cache with network_info: [{"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:18:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-22b603d5-8f88-4f78-abb0-63af1ba4378e req-65016608-e7e1-4874-9459-e734ff75995f service nova] Releasing lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-1b2c2c82-f2cd-4933-9f72-ba9bca1e3013 req-39c3e514-e6cf-4a21-88f2-e1c55c55b170 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b2c2c82-f2cd-4933-9f72-ba9bca1e3013 req-39c3e514-e6cf-4a21-88f2-e1c55c55b170 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b2c2c82-f2cd-4933-9f72-ba9bca1e3013 req-39c3e514-e6cf-4a21-88f2-e1c55c55b170 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-1b2c2c82-f2cd-4933-9f72-ba9bca1e3013 req-39c3e514-e6cf-4a21-88f2-e1c55c55b170 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:54 user nova-compute[70594]: DEBUG nova.compute.manager [req-1b2c2c82-f2cd-4933-9f72-ba9bca1e3013 req-39c3e514-e6cf-4a21-88f2-e1c55c55b170 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:54 user nova-compute[70594]: WARNING nova.compute.manager [req-1b2c2c82-f2cd-4933-9f72-ba9bca1e3013 req-39c3e514-e6cf-4a21-88f2-e1c55c55b170 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received unexpected event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with vm_state building and task_state spawning.
Jul 26 17:18:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391936.0048895, 08bc58e4-d6b2-493a-9d0f-ff43546997bc => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] VM Resumed (Lifecycle Event)
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Instance spawned successfully.
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-dae53712-e538-4640-8e8d-3658f2c3a97b req-acef2964-ca0a-4169-85cd-60d5f844c36d service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dae53712-e538-4640-8e8d-3658f2c3a97b req-acef2964-ca0a-4169-85cd-60d5f844c36d service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dae53712-e538-4640-8e8d-3658f2c3a97b req-acef2964-ca0a-4169-85cd-60d5f844c36d service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dae53712-e538-4640-8e8d-3658f2c3a97b req-acef2964-ca0a-4169-85cd-60d5f844c36d service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-dae53712-e538-4640-8e8d-3658f2c3a97b req-acef2964-ca0a-4169-85cd-60d5f844c36d service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:18:56 user nova-compute[70594]: WARNING nova.compute.manager [req-dae53712-e538-4640-8e8d-3658f2c3a97b req-acef2964-ca0a-4169-85cd-60d5f844c36d service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received unexpected event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with vm_state building and task_state spawning.
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391936.0083308, 08bc58e4-d6b2-493a-9d0f-ff43546997bc => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] VM Started (Lifecycle Event)
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Took 6.58 seconds to spawn the instance on the hypervisor.
Jul 26 17:18:56 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:18:56 user nova-compute[70594]: INFO nova.compute.manager [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Took 7.38 seconds to build instance.
Jul 26 17:18:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3ef63aa8-d37c-4161-8212-8f8e84c3d487 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.488s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:18:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:18:58 user nova-compute[70594]: INFO nova.compute.claims [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Claim successful on node user
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:18:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.789s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:18:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:18:58 user nova-compute[70594]: INFO nova.virt.block_device [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Booting with volume snapshot eb933f3d-7de8-4945-a28b-93c7b1fdff60 at /dev/vda
Jul 26 17:18:58 user nova-compute[70594]: DEBUG nova.policy [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd221b17924ce3b9770c36fbbb52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f39be2f463416faaeae34d088bb57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:18:59 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Successfully created port: 86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Successfully updated port: 86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquired lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-changed-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Refreshing instance network info cache due to event network-changed-86fd1d90-91c7-4794-85e7-befdf76db1a6. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:19:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] Acquiring lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG nova.network.neutron [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updating instance_info_cache with network_info: [{"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Releasing lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Instance network_info: |[{"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] Acquired lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Refreshing network info cache for port 86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updated VIF entry in instance network info cache for port 86fd1d90-91c7-4794-85e7-befdf76db1a6. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG nova.network.neutron [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updating instance_info_cache with network_info: [{"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c017520f-f71f-4b1d-ae5b-c395eba99f12 req-d17d3342-68a5-4a30-a85a-378e00c54d19 service nova] Releasing lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:19:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:19:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:19:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:19:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:19:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3501c954-cd6d-4a3f-b5d4-29e58086e7ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaa9765-c4e7-4657-bf6f-94770861c1c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1babf6-dce4-4136-a805-cd50fe234d36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b156797-e744-4174-b8b2-ec08b2348337]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:04 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:19:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8badf223-cdcb-4cca-a0b5-e9107ef07ffe]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG os_brick.utils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:04 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updating existing volume attachment record: 45321576-a6dd-4000-a251-3738d461786e {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:19:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-changed-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG nova.compute.manager [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Refreshing instance network info cache due to event network-changed-13246c09-d31b-4121-9f1d-8989d931a33d. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] Acquiring lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] Acquired lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG nova.network.neutron [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Refreshing network info cache for port 13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG nova.network.neutron [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updated VIF entry in instance network info cache for port 13246c09-d31b-4121-9f1d-8989d931a33d. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:19:07 user nova-compute[70594]: DEBUG nova.network.neutron [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating instance_info_cache with network_info: [{"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dc25f758-be09-4bd0-8ebd-69e0eb460aa1 req-3a5731e0-7763-42f4-94ac-b9a8b98547fa service nova] Releasing lock "refresh_cache-808c3361-0697-42f4-bea3-5107c614ef0f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:19:10 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:12 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:19:13 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Creating image(s)
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Ensure instance console log exists: /opt/stack/data/nova/instances/54148d5d-469e-4bc5-b533-fed00053bdcc/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Start _get_guest_xml network_info=[{"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-26T17:18:51Z,direct_url=<?>,disk_format='qcow2',id=8a81205b-23b4-46d6-b918-70bdab528f1a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-951417523',owner='05f39be2f463416faaeae34d088bb57c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-26T17:18:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udmlAFwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54148d5d-469e-4bc5-b533-fed00053bdcc', 'attached_at': '', 'detached_at': '', 'volume_id': '368cfd87-1308-4676-bf9a-d2fdcb835056', 'serial': '368cfd87-1308-4676-bf9a-d2fdcb835056'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '45321576-a6dd-4000-a251-3738d461786e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:19:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:19:13 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:13 user nova-compute[70594]: INFO nova.compute.manager [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attaching volume 105c1472-ec6b-4fda-a7cf-0243d2d57c71 to /dev/vdb
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-26T17:18:51Z,direct_url=<?>,disk_format='qcow2',id=8a81205b-23b4-46d6-b918-70bdab528f1a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-951417523',owner='05f39be2f463416faaeae34d088bb57c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-26T17:18:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udmlAFwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:13 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:13 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:13 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2722ef20-6752-4e16-90fb-fc55d53d7ac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:19:13 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cdbf47-5e52-4a18-89a8-ffa86f07dcc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056] added
Jul 26 17:19:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.utils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83591b20-aa96-4f51-b35e-429eb9f36c32]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[158cdc82-8632-4736-94d7-d3bcb455b856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d54417-5b67-4bea-be0a-d10dd6fe0ffb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v udmlAFwx {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58619ed7-680b-4996-a899-db90be9bd908]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v udmlAFwx" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a16b3-607c-4f3b-8384-71fd78cb2cd6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'udmlAFwx'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de2eaa-d871-4c16-b418-a869862aeb62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a42abe-f78f-4195-85f5-7fa9142f9f39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3afd1bd-3857-4fa6-bfdb-4dd2e439f04c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:13 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcf274-5c50-40e9-ac61-f4c1bea1f1ca]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.utils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating existing volume attachment record: 92063481-9108-412b-961f-5b5223c63627 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c94a81-24b7-4711-ac46-0c2aadb55040]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd920565-6c5e-490a-a4fb-f5db1bfb572e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260]
Jul 26 17:19:13 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260] successful.
Jul 26 17:19:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d29db8-cb1d-4693-8ee9-f0d9b4748f0e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf9dc5-590d-4d99-aec1-60b610e6d14f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:13 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[688b68da-b5ac-4118-a291-0bf59ac57e09]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:13 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:19:14 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:19:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udmlAFwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:19:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26564643661376335', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564643661376335', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-256645042',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-256645042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-256645042',id=44,image_ref='8a81205b-23b4-46d6-b918-70bdab528f1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzmi9dCTh04Llvv0PHv5P/QGDfidFe22m3CJ5LgfuL6RLIdT8kQBOEjoClXKLzpHwiTrenqzkJu/bs4lrw7H3PJyJBErZ3vG/pQudYZDz84rxDc/vOFvmxM7SsRQzH7Ew==',key_name='tempest-keypair-1262621850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-lib24rxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-491432484',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=54148d5d-469e-4bc5-b533-fed00053bdcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.objects.instance [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'pci_devices' on Instance uuid 54148d5d-469e-4bc5-b533-fed00053bdcc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:19:15 user nova-compute[70594]:   <uuid>54148d5d-469e-4bc5-b533-fed00053bdcc</uuid>
Jul 26 17:19:15 user nova-compute[70594]:   <name>instance-0000002c</name>
Jul 26 17:19:15 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:19:15 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:19:15 user nova-compute[70594]:   <metadata>
Jul 26 17:19:15 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:19:15 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:19:15 user nova-compute[70594]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-256645042</nova:name>
Jul 26 17:19:15 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:19:13</nova:creationTime>
Jul 26 17:19:15 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:19:15 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:19:15 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:19:15 user nova-compute[70594]:       <nova:owner>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:user uuid="68fd221b17924ce3b9770c36fbbb52df">tempest-TestVolumeBootPattern-491432484-project-member</nova:user>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:project uuid="05f39be2f463416faaeae34d088bb57c">tempest-TestVolumeBootPattern-491432484</nova:project>
Jul 26 17:19:15 user nova-compute[70594]:       </nova:owner>
Jul 26 17:19:15 user nova-compute[70594]:       <nova:root type="image" uuid="8a81205b-23b4-46d6-b918-70bdab528f1a"/>
Jul 26 17:19:15 user nova-compute[70594]:       <nova:ports>
Jul 26 17:19:15 user nova-compute[70594]:         <nova:port uuid="86fd1d90-91c7-4794-85e7-befdf76db1a6">
Jul 26 17:19:15 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 26 17:19:15 user nova-compute[70594]:         </nova:port>
Jul 26 17:19:15 user nova-compute[70594]:       </nova:ports>
Jul 26 17:19:15 user nova-compute[70594]:     </nova:instance>
Jul 26 17:19:15 user nova-compute[70594]:   </metadata>
Jul 26 17:19:15 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:19:15 user nova-compute[70594]:     <system>
Jul 26 17:19:15 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:19:15 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:19:15 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:19:15 user nova-compute[70594]:       <entry name="serial">54148d5d-469e-4bc5-b533-fed00053bdcc</entry>
Jul 26 17:19:15 user nova-compute[70594]:       <entry name="uuid">54148d5d-469e-4bc5-b533-fed00053bdcc</entry>
Jul 26 17:19:15 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:19:15 user nova-compute[70594]:     </system>
Jul 26 17:19:15 user nova-compute[70594]:   </sysinfo>
Jul 26 17:19:15 user nova-compute[70594]:   <os>
Jul 26 17:19:15 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:19:15 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:19:15 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:19:15 user nova-compute[70594]:   </os>
Jul 26 17:19:15 user nova-compute[70594]:   <features>
Jul 26 17:19:15 user nova-compute[70594]:     <acpi/>
Jul 26 17:19:15 user nova-compute[70594]:     <apic/>
Jul 26 17:19:15 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:19:15 user nova-compute[70594]:   </features>
Jul 26 17:19:15 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:19:15 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:19:15 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:19:15 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:19:15 user nova-compute[70594]:   </clock>
Jul 26 17:19:15 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:19:15 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:19:15 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:19:15 user nova-compute[70594]:   </cpu>
Jul 26 17:19:15 user nova-compute[70594]:   <devices>
Jul 26 17:19:15 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:19:15 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:15 user nova-compute[70594]:       <source dev="/dev/sdc"/>
Jul 26 17:19:15 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:19:15 user nova-compute[70594]:       <serial>368cfd87-1308-4676-bf9a-d2fdcb835056</serial>
Jul 26 17:19:15 user nova-compute[70594]:     </disk>
Jul 26 17:19:15 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:19:15 user nova-compute[70594]:       <mac address="fa:16:3e:d9:a7:b1"/>
Jul 26 17:19:15 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:19:15 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:19:15 user nova-compute[70594]:       <target dev="tap86fd1d90-91"/>
Jul 26 17:19:15 user nova-compute[70594]:     </interface>
Jul 26 17:19:15 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:19:15 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/54148d5d-469e-4bc5-b533-fed00053bdcc/console.log" append="off"/>
Jul 26 17:19:15 user nova-compute[70594]:     </serial>
Jul 26 17:19:15 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:19:15 user nova-compute[70594]:     <video>
Jul 26 17:19:15 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:19:15 user nova-compute[70594]:     </video>
Jul 26 17:19:15 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:19:15 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:19:15 user nova-compute[70594]:     </rng>
Jul 26 17:19:15 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:19:15 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:19:15 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:19:15 user nova-compute[70594]:     </memballoon>
Jul 26 17:19:15 user nova-compute[70594]:   </devices>
Jul 26 17:19:15 user nova-compute[70594]: </domain>
Jul 26 17:19:15 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-256645042',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-256645042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-256645042',id=44,image_ref='8a81205b-23b4-46d6-b918-70bdab528f1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzmi9dCTh04Llvv0PHv5P/QGDfidFe22m3CJ5LgfuL6RLIdT8kQBOEjoClXKLzpHwiTrenqzkJu/bs4lrw7H3PJyJBErZ3vG/pQudYZDz84rxDc/vOFvmxM7SsRQzH7Ew==',key_name='tempest-keypair-1262621850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-lib24rxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-491432484',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:18:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=54148d5d-469e-4bc5-b533-fed00053bdcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG os_vif [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86fd1d90-91, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86fd1d90-91, col_values=(('external_ids', {'iface-id': '86fd1d90-91c7-4794-85e7-befdf76db1a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:a7:b1', 'vm-uuid': '54148d5d-469e-4bc5-b533-fed00053bdcc'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:15 user nova-compute[70594]: INFO os_vif [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91')
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No VIF found with MAC fa:16:3e:d9:a7:b1, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-54836f40-ce20-4853-81fe-cf5c6f78f62b req-64ab1025-9d0f-4c07-b48a-298248e42056 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-54836f40-ce20-4853-81fe-cf5c6f78f62b req-64ab1025-9d0f-4c07-b48a-298248e42056 service nova] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-54836f40-ce20-4853-81fe-cf5c6f78f62b req-64ab1025-9d0f-4c07-b48a-298248e42056 service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-54836f40-ce20-4853-81fe-cf5c6f78f62b req-64ab1025-9d0f-4c07-b48a-298248e42056 service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-54836f40-ce20-4853-81fe-cf5c6f78f62b req-64ab1025-9d0f-4c07-b48a-298248e42056 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] No waiting events found dispatching network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:19:16 user nova-compute[70594]: WARNING nova.compute.manager [req-54836f40-ce20-4853-81fe-cf5c6f78f62b req-64ab1025-9d0f-4c07-b48a-298248e42056 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received unexpected event network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 for instance with vm_state building and task_state spawning.
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391958.59772, 54148d5d-469e-4bc5-b533-fed00053bdcc => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] VM Resumed (Lifecycle Event)
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Instance spawned successfully.
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690391958.5985706, 54148d5d-469e-4bc5-b533-fed00053bdcc => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] VM Started (Lifecycle Event)
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Took 5.21 seconds to spawn the instance on the hypervisor.
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a713336-ed3e-4560-a940-c0926285df6f req-979acfef-2031-437d-a25b-4e7c37db0cb9 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a713336-ed3e-4560-a940-c0926285df6f req-979acfef-2031-437d-a25b-4e7c37db0cb9 service nova] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a713336-ed3e-4560-a940-c0926285df6f req-979acfef-2031-437d-a25b-4e7c37db0cb9 service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8a713336-ed3e-4560-a940-c0926285df6f req-979acfef-2031-437d-a25b-4e7c37db0cb9 service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-8a713336-ed3e-4560-a940-c0926285df6f req-979acfef-2031-437d-a25b-4e7c37db0cb9 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] No waiting events found dispatching network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:19:18 user nova-compute[70594]: WARNING nova.compute.manager [req-8a713336-ed3e-4560-a940-c0926285df6f req-979acfef-2031-437d-a25b-4e7c37db0cb9 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received unexpected event network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 for instance with vm_state building and task_state spawning.
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: INFO nova.compute.manager [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Took 20.87 seconds to build instance.
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-ac899be2-581b-4ced-bc74-ab3ffb0f6882 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.008s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:19:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:19:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:19:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7275MB free_disk=24.89993667602539GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Applying migration context for instance 356f54bb-c75c-4e17-8193-65f8a662e572 as it has an incoming, in-progress migration dd4ae860-67e8-4491-a24e-bb74e44fef57. Migration status is finished {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:987}}
Jul 26 17:19:20 user nova-compute[70594]: INFO nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating resource usage from migration dd4ae860-67e8-4491-a24e-bb74e44fef57
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 8ef02326-71b1-43ca-a53d-c2f73b049896 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 70df069f-5f6c-4463-aa0d-4a323de18b10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 808c3361-0697-42f4-bea3-5107c614ef0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Migration dd4ae860-67e8-4491-a24e-bb74e44fef57 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1674}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6d000228-a585-4c95-af6d-d9b2d8b35993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 54148d5d-469e-4bc5-b533-fed00053bdcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.866s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewMyUvAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:20 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:19:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aee0a4-d853-4173-a47e-7d37ba8d75fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:19:20 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.052s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aa681e-3c7d-470d-9423-9fb3450cb055]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71] added
Jul 26 17:19:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c48a9-7c5d-42b9-88f9-5e02f8431d8b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bfec06-4915-41f3-94e6-7cfca56977b0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewMyUvAb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewMyUvAb" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dcc93e-3ab7-4b08-b3ef-92dd99007306]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewMyUvAb'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[95965e40-3034-4145-ab92-6f3c57dda514]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b501c2-0e18-4f50-81fe-3db23098d26f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b804a45-6018-4f75-b9e5-da6796bf44e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260]
Jul 26 17:19:21 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260] successful.
Jul 26 17:19:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d0de5-2eca-4126-b011-3b73bc06a5be]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced423aa-3422-4149-890d-c0767f7dae6e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:21 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf026717-b6a7-447f-8be8-b110faac1ac8]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewMyUvAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:19:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26330663864316336', 'path': '/dev/sdf'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330663864316336', 'path': '/dev/sdf'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:19:22 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:22 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:19:22 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:19:22 user nova-compute[70594]:   <serial>105c1472-ec6b-4fda-a7cf-0243d2d57c71</serial>
Jul 26 17:19:22 user nova-compute[70594]: </disk>
Jul 26 17:19:22 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No VIF found with MAC fa:16:3e:6e:5c:32, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:19:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e0a4da-7fa6-4e11-8789-60c4a34d90e8 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.395s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:24 user nova-compute[70594]: INFO nova.compute.manager [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Terminating instance
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c890341-7edc-4799-9eb4-9fa3ec15358f req-47b1da6d-aaa2-4427-a10f-711a5dcae67c service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-vif-unplugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c890341-7edc-4799-9eb4-9fa3ec15358f req-47b1da6d-aaa2-4427-a10f-711a5dcae67c service nova] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c890341-7edc-4799-9eb4-9fa3ec15358f req-47b1da6d-aaa2-4427-a10f-711a5dcae67c service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c890341-7edc-4799-9eb4-9fa3ec15358f req-47b1da6d-aaa2-4427-a10f-711a5dcae67c service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c890341-7edc-4799-9eb4-9fa3ec15358f req-47b1da6d-aaa2-4427-a10f-711a5dcae67c service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] No waiting events found dispatching network-vif-unplugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c890341-7edc-4799-9eb4-9fa3ec15358f req-47b1da6d-aaa2-4427-a10f-711a5dcae67c service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-vif-unplugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Instance destroyed successfully.
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'resources' on Instance uuid 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908853552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908853552',id=32,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-gjsogfon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:11:58Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=53ab95cc-52ba-45b2-951c-a33ce8bc0dcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "address": "fa:16:3e:87:07:f4", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c5d4d4-55", "ovs_interfaceid": "b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG os_vif [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9c5d4d4-55, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:19:24 user nova-compute[70594]: INFO os_vif [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:07:f4,bridge_name='br-int',has_traffic_filtering=True,id=b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c5d4d4-55')
Jul 26 17:19:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Deleting instance files /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc_del
Jul 26 17:19:24 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Deletion of /opt/stack/data/nova/instances/53ab95cc-52ba-45b2-951c-a33ce8bc0dcc_del complete
Jul 26 17:19:24 user nova-compute[70594]: INFO nova.compute.manager [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 26 17:19:24 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:19:24 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:25 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Took 0.48 seconds to deallocate network for instance.
Jul 26 17:19:25 user nova-compute[70594]: DEBUG nova.compute.manager [req-68a5dc40-998a-4d28-b4e4-59783ea99013 req-9e9609a7-149c-4e92-8fb8-dbab81131df2 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-vif-deleted-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:19:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:25 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Deleted allocations for instance 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-b472b337-48a7-49d7-a017-87149cbbdab4 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG nova.objects.instance [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:26 user nova-compute[70594]: INFO nova.compute.manager [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attaching volume 2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 to /dev/vdc
Jul 26 17:19:26 user nova-compute[70594]: DEBUG os_brick.utils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e014e9-0b4e-4dd8-9fdb-0cf5b4383539]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77873b4-e4ee-4f0e-b119-d4e08d282890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3534b5c6-29e7-4957-ab30-993d799f7830]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e927b-f50f-485b-a5d2-d368ed10346b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:26 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b9033-e1f2-4418-bb87-c9e7c54ea72e]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG os_brick.utils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating existing volume attachment record: be084468-8690-4cfe-b533-0c8bf41d3fb1 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-f4e9b753-67cf-421c-8bb2-6f7776507b28 req-693454c0-3af9-4f60-b126-5326894e49f6 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received event network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f4e9b753-67cf-421c-8bb2-6f7776507b28 req-693454c0-3af9-4f60-b126-5326894e49f6 service nova] Acquiring lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f4e9b753-67cf-421c-8bb2-6f7776507b28 req-693454c0-3af9-4f60-b126-5326894e49f6 service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f4e9b753-67cf-421c-8bb2-6f7776507b28 req-693454c0-3af9-4f60-b126-5326894e49f6 service nova] Lock "53ab95cc-52ba-45b2-951c-a33ce8bc0dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-f4e9b753-67cf-421c-8bb2-6f7776507b28 req-693454c0-3af9-4f60-b126-5326894e49f6 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] No waiting events found dispatching network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:19:26 user nova-compute[70594]: WARNING nova.compute.manager [req-f4e9b753-67cf-421c-8bb2-6f7776507b28 req-693454c0-3af9-4f60-b126-5326894e49f6 service nova] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Received unexpected event network-vif-plugged-b9c5d4d4-558d-4fa2-81aa-deed54f4d4b0 for instance with vm_state deleted and task_state None.
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Going to confirm migration 2 {{(pid=70594) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquired lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'info_cache' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [{"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Releasing lock "refresh_cache-356f54bb-c75c-4e17-8193-65f8a662e572" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'migration_context' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:19:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.418s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:28 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Deleted allocation for migration dd4ae860-67e8-4491-a24e-bb74e44fef57
Jul 26 17:19:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2fcf2075-8cdd-4f80-a85b-27e3dbcb10fb tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.531s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKAqaHzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:33 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:33 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:33 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c0c4b5-eb9f-43c3-bcc9-a8a1b9b2497f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:19:33 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a2d530-14dd-477a-9dde-c4e8eeab5daa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39] added
Jul 26 17:19:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4865cf-746f-4c81-9f70-356c75629e58]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8d27e-4d4f-42fd-b032-36fa4d27916a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKAqaHzG {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WKAqaHzG" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafda6e5-b8e2-4a87-88bc-276f2f52fd4b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WKAqaHzG'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a08c14-22f8-4c87-b655-68d706f20d4a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2dffca-1f07-48a8-b748-30af006b48b7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aaaa0a-2aec-4ff6-b0cd-0669084b8d82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260]
Jul 26 17:19:33 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260] successful.
Jul 26 17:19:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecaaf27-8dad-45d3-9e5d-f7a3f6ebe389]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[af876679-1f9f-4b67-a161-7e44ab91cf8a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)
Jul 26 17:19:33 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] HCTL ('38', '-', '-', 0) found on session 50 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae14590-fe4a-4d1c-8b5a-650406541a99]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Searching for a device in session 50 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:19:33 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKAqaHzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23339653738396431', 'path': '/dev/sdg'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339653738396431', 'path': '/dev/sdg'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG nova.objects.instance [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:19:34 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:34 user nova-compute[70594]:   <source dev="/dev/sdg"/>
Jul 26 17:19:34 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:19:34 user nova-compute[70594]:   <serial>2f3473b3-7bb3-4546-bfb3-9b0649ae2d39</serial>
Jul 26 17:19:34 user nova-compute[70594]: </disk>
Jul 26 17:19:34 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:19:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:19:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:19:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:19:35 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] No VIF found with MAC fa:16:3e:6e:5c:32, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:19:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-da27b6f1-86fc-49ce-bc08-5c454a9a0ec2 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.081s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:36 user nova-compute[70594]: INFO nova.compute.manager [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Detaching volume 105c1472-ec6b-4fda-a7cf-0243d2d57c71
Jul 26 17:19:36 user nova-compute[70594]: INFO nova.virt.block_device [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attempting to driver detach volume 105c1472-ec6b-4fda-a7cf-0243d2d57c71 from mountpoint /dev/vdb
Jul 26 17:19:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Attempting to detach device vdb from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:19:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:19:36 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:36 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:19:36 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:19:36 user nova-compute[70594]:   <serial>105c1472-ec6b-4fda-a7cf-0243d2d57c71</serial>
Jul 26 17:19:36 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:19:36 user nova-compute[70594]: </disk>
Jul 26 17:19:36 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:19:36 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully detached device vdb from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the persistent domain config.
Jul 26 17:19:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:19:36 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:19:36 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:36 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:19:36 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:19:36 user nova-compute[70594]:   <serial>105c1472-ec6b-4fda-a7cf-0243d2d57c71</serial>
Jul 26 17:19:36 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:19:36 user nova-compute[70594]: </disk>
Jul 26 17:19:36 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391977.0062788, 808c3361-0697-42f4-bea3-5107c614ef0f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:19:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully detached device vdb from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the live domain config.
Jul 26 17:19:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewMyUvAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:37 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8cfe82-0e57-4899-a921-bb34fef38bed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:19:37 user nova-compute[70594]: No targets found.
Jul 26 17:19:37 user nova-compute[70594]: iSNS:
Jul 26 17:19:37 user nova-compute[70594]: No targets found.
Jul 26 17:19:37 user nova-compute[70594]: STATIC:
Jul 26 17:19:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39
Jul 26 17:19:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:19:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:19:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:19:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056
Jul 26 17:19:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:37 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71
Jul 26 17:19:37 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:37 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:37 user nova-compute[70594]: FIRMWARE:
Jul 26 17:19:37 user nova-compute[70594]: No targets found.
Jul 26 17:19:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:19:37 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:19:37 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4d7a3-1e55-4ccb-9fea-6b93bc7ae98f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9426335d-8434-4453-85c4-4d2ef1ef903e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)
Jul 26 17:19:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59103ee320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71'): ({'sdf'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Removing single pathed devices sdf {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1612e-5066-45d9-8901-2705ea5bdf6b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e312ab78-fdab-4252-bfa7-876a9dcb6b3c]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flushing IO for device /dev/sdf {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30860759-7ef9-4c51-b3da-269400d663c7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37234ca1-504e-474c-9df3-cc72ab4ec01f]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda7c5e-4a02-41ac-8215-927e90a0fe2a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1bdc3-bd5e-48d6-ae39-143daf50de0f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260]
Jul 26 17:19:37 user nova-compute[70594]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71, portal: 172.16.0.220,3260] successful.
Jul 26 17:19:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105c1472-ec6b-4fda-a7cf-0243d2d57c71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd2a47-82f1-4c25-93b9-a3903c44e3df]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== disconnect_volume: return (324ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:19:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-7d66cbe0-e884-4298-a8b1-56981cec5dab tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.749s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:38 user nova-compute[70594]: INFO nova.compute.manager [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Detaching volume 2f3473b3-7bb3-4546-bfb3-9b0649ae2d39
Jul 26 17:19:38 user nova-compute[70594]: INFO nova.virt.block_device [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Attempting to driver detach volume 2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 from mountpoint /dev/vdc
Jul 26 17:19:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Attempting to detach device vdc from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:19:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:19:38 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:38 user nova-compute[70594]:   <source dev="/dev/sdg"/>
Jul 26 17:19:38 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:19:38 user nova-compute[70594]:   <serial>2f3473b3-7bb3-4546-bfb3-9b0649ae2d39</serial>
Jul 26 17:19:38 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 26 17:19:38 user nova-compute[70594]: </disk>
Jul 26 17:19:38 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:19:38 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully detached device vdc from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the persistent domain config.
Jul 26 17:19:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:19:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:19:38 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:19:38 user nova-compute[70594]:   <source dev="/dev/sdg"/>
Jul 26 17:19:38 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:19:38 user nova-compute[70594]:   <serial>2f3473b3-7bb3-4546-bfb3-9b0649ae2d39</serial>
Jul 26 17:19:38 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 26 17:19:38 user nova-compute[70594]: </disk>
Jul 26 17:19:38 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690391979.396278, 808c3361-0697-42f4-bea3-5107c614ef0f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:19:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully detached device vdc from instance 808c3361-0697-42f4-bea3-5107c614ef0f from the live domain config.
Jul 26 17:19:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WKAqaHzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:39 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc44ef-7174-48d3-80db-bdf38ce6f58f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:19:39 user nova-compute[70594]: No targets found.
Jul 26 17:19:39 user nova-compute[70594]: iSNS:
Jul 26 17:19:39 user nova-compute[70594]: No targets found.
Jul 26 17:19:39 user nova-compute[70594]: STATIC:
Jul 26 17:19:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39
Jul 26 17:19:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:19:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:19:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:19:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056
Jul 26 17:19:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:19:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:19:39 user nova-compute[70594]: FIRMWARE:
Jul 26 17:19:39 user nova-compute[70594]: No targets found.
Jul 26 17:19:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:19:39 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:19:39 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb11c8c4-e7ab-4223-ac23-9b86fcb57b3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[884bf2ca-3dd5-4945-8461-f76b28072e79]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 (non-flash)
Jul 26 17:19:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59103eeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39'): ({'sdg'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Removing single pathed devices sdg {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43239104-c363-46fc-bee7-d74c50220b8b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4040cf-475a-4ec8-877c-73c6c294f640]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Flushing IO for device /dev/sdg {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8170bff-053e-46ca-b8ef-8df48e4652f9]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d062f0-d6a3-455a-ad5f-df5f265fa522]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] SCSI volumes sdg have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c4145d-47f0-4b4c-89a5-fe813171e1f4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46bca18-9a96-4072-bb41-e536cc0fefb1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260]
Jul 26 17:19:39 user nova-compute[70594]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39, portal: 172.16.0.220,3260] successful.
Jul 26 17:19:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3473b3-7bb3-4546-bfb3-9b0649ae2d39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a3b8e0-60a7-413a-ad05-47853fd39b5f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] <== disconnect_volume: return (315ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391964.8804812, 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:19:39 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] VM Stopped (Lifecycle Event)
Jul 26 17:19:39 user nova-compute[70594]: DEBUG nova.compute.manager [None req-06498f21-2c44-4fcf-a101-27c9ce033dc9 None None] [instance: 53ab95cc-52ba-45b2-951c-a33ce8bc0dcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:19:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:40 user nova-compute[70594]: DEBUG nova.objects.instance [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'flavor' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-be107a48-7b68-4692-b205-d503ea10a085 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:41 user nova-compute[70594]: INFO nova.compute.manager [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Terminating instance
Jul 26 17:19:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-56142912-319a-46c1-9b3b-b346d191c249 req-aadefe74-1fe7-40aa-9604-14fe3670d187 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-vif-unplugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-56142912-319a-46c1-9b3b-b346d191c249 req-aadefe74-1fe7-40aa-9604-14fe3670d187 service nova] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-56142912-319a-46c1-9b3b-b346d191c249 req-aadefe74-1fe7-40aa-9604-14fe3670d187 service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-56142912-319a-46c1-9b3b-b346d191c249 req-aadefe74-1fe7-40aa-9604-14fe3670d187 service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-56142912-319a-46c1-9b3b-b346d191c249 req-aadefe74-1fe7-40aa-9604-14fe3670d187 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] No waiting events found dispatching network-vif-unplugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:19:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-56142912-319a-46c1-9b3b-b346d191c249 req-aadefe74-1fe7-40aa-9604-14fe3670d187 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-vif-unplugged-13246c09-d31b-4121-9f1d-8989d931a33d for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:19:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Instance destroyed successfully.
Jul 26 17:19:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lazy-loading 'resources' on Instance uuid 808c3361-0697-42f4-bea3-5107c614ef0f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-776825008',display_name='tempest-AttachVolumeTestJSON-server-776825008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-776825008',id=40,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyAn55gbm6eUVcAiVtZBdgTC174rlpfvjj64SochTlgUtHgk2ZWHDfgcL0nFnc6VKusmuP2wMHuNlEQ+b41znQgtg+Y2aK5+Q75cwP6E2rj4fL9G2A91poCNc0R7WdFHQ==',key_name='tempest-keypair-1979327711',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:17:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0459f7d07ec54e3bbfe3915b2b7cfd7b',ramdisk_id='',reservation_id='r-08aowyuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-35291756',owner_user_name='tempest-AttachVolumeTestJSON-35291756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c300fdc9bda48b1afdd00fbc5a6245e',uuid=808c3361-0697-42f4-bea3-5107c614ef0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converting VIF {"id": "13246c09-d31b-4121-9f1d-8989d931a33d", "address": "fa:16:3e:6e:5c:32", "network": {"id": "21894983-69b4-45c0-8040-d89f132d904f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1776761611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0459f7d07ec54e3bbfe3915b2b7cfd7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13246c09-d3", "ovs_interfaceid": "13246c09-d31b-4121-9f1d-8989d931a33d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG os_vif [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13246c09-d3, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:19:42 user nova-compute[70594]: INFO os_vif [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=13246c09-d31b-4121-9f1d-8989d931a33d,network=Network(21894983-69b4-45c0-8040-d89f132d904f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13246c09-d3')
Jul 26 17:19:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Deleting instance files /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f_del
Jul 26 17:19:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Deletion of /opt/stack/data/nova/instances/808c3361-0697-42f4-bea3-5107c614ef0f_del complete
Jul 26 17:19:42 user nova-compute[70594]: INFO nova.compute.manager [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 26 17:19:42 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:19:42 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-aebd2aec-e320-4b79-a710-06375910a0f6 req-7da2966b-0955-4a88-90b1-e086113cd252 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-vif-deleted-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:43 user nova-compute[70594]: INFO nova.compute.manager [req-aebd2aec-e320-4b79-a710-06375910a0f6 req-7da2966b-0955-4a88-90b1-e086113cd252 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Neutron deleted interface 13246c09-d31b-4121-9f1d-8989d931a33d; detaching it from the instance and deleting it from the info cache
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.network.neutron [req-aebd2aec-e320-4b79-a710-06375910a0f6 req-7da2966b-0955-4a88-90b1-e086113cd252 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:43 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Took 0.89 seconds to deallocate network for instance.
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-aebd2aec-e320-4b79-a710-06375910a0f6 req-7da2966b-0955-4a88-90b1-e086113cd252 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Detach interface failed, port_id=13246c09-d31b-4121-9f1d-8989d931a33d, reason: Instance 808c3361-0697-42f4-bea3-5107c614ef0f could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:43 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Deleted allocations for instance 808c3361-0697-42f4-bea3-5107c614ef0f
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b76293d-11ad-4afd-9553-ccbd5b35a712 tempest-AttachVolumeTestJSON-35291756 tempest-AttachVolumeTestJSON-35291756-project-member] Lock "808c3361-0697-42f4-bea3-5107c614ef0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.290s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-0bd1d321-e7a2-4e25-a229-09c41780cf68 req-70e45579-f7c8-4c21-8ec3-e17ae6304fd0 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received event network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0bd1d321-e7a2-4e25-a229-09c41780cf68 req-70e45579-f7c8-4c21-8ec3-e17ae6304fd0 service nova] Acquiring lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0bd1d321-e7a2-4e25-a229-09c41780cf68 req-70e45579-f7c8-4c21-8ec3-e17ae6304fd0 service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0bd1d321-e7a2-4e25-a229-09c41780cf68 req-70e45579-f7c8-4c21-8ec3-e17ae6304fd0 service nova] Lock "808c3361-0697-42f4-bea3-5107c614ef0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-0bd1d321-e7a2-4e25-a229-09c41780cf68 req-70e45579-f7c8-4c21-8ec3-e17ae6304fd0 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] No waiting events found dispatching network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:19:43 user nova-compute[70594]: WARNING nova.compute.manager [req-0bd1d321-e7a2-4e25-a229-09c41780cf68 req-70e45579-f7c8-4c21-8ec3-e17ae6304fd0 service nova] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Received unexpected event network-vif-plugged-13246c09-d31b-4121-9f1d-8989d931a33d for instance with vm_state deleted and task_state None.
Jul 26 17:19:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-changed-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:19:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Refreshing instance network info cache due to event network-changed-f2055bc6-97f4-44b4-80be-962a102a6668. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:19:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] Acquiring lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:19:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] Acquired lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:19:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Refreshing network info cache for port f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:19:51 user nova-compute[70594]: DEBUG nova.network.neutron [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updated VIF entry in instance network info cache for port f2055bc6-97f4-44b4-80be-962a102a6668. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:19:51 user nova-compute[70594]: DEBUG nova.network.neutron [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updating instance_info_cache with network_info: [{"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:19:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-51af88f8-efd0-4481-a9a3-95fe245bb4aa req-db624523-b06e-4f75-9b14-db1c643ded24 service nova] Releasing lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:19:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'flavor' on Instance uuid 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:19:52 user nova-compute[70594]: INFO nova.compute.manager [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Attaching volume 8d400f9e-6992-49ed-8d50-9e514fc38d20 to /dev/vdb
Jul 26 17:19:52 user nova-compute[70594]: DEBUG os_brick.utils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ef0d0b-13d1-4c7c-af2e-d6fa5108cce4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60c301-d0d7-461c-93e1-de34c14b5517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[53531411-c37d-4a56-837d-3b3279be2e18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c31e82-6225-4ce3-a649-ec6845182de8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:19:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:19:53 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:19:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce343f7-1132-438c-9918-fe3fb0551419]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:19:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:19:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:19:53 user nova-compute[70594]: DEBUG os_brick.utils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:19:53 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updating existing volume attachment record: 6266c6f7-088e-4dfd-9b8a-77fbf1607c5c {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:19:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:57 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690391982.2440517, 808c3361-0697-42f4-bea3-5107c614ef0f => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:19:57 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] VM Stopped (Lifecycle Event)
Jul 26 17:19:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-edc44e0f-84c0-4579-8928-9582a3e07bf4 None None] [instance: 808c3361-0697-42f4-bea3-5107c614ef0f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:19:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahlskVcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:19:59 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:59 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:19:59 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f3ff7-0c63-4d46-9146-62cd704a1582]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:19:59 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[100bb49f-5666-4675-9978-6e962e609f01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20] added
Jul 26 17:19:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8788a46a-e4e3-4b1e-8e1f-df1dbaf57920]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d318e7b-4e11-4aa3-9e42-89d77f453c6b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahlskVcK {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahlskVcK" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6dbcb-7d4f-433f-b7e7-b245f2598e0f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahlskVcK'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[08628504-a90c-437c-978a-f4a15d608e5b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d43a21d-41e5-4990-9b36-c0cf99a6f2b2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5cdde-6cdd-41cb-a251-2660f6d567ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260]
Jul 26 17:19:59 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260] successful.
Jul 26 17:19:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb9e05-f231-42d8-87de-f81053b726ab]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d358012d-62b8-48c4-9029-1c8c200d9cfa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 (non-flash)
Jul 26 17:19:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] HCTL ('37', '-', '-', 0) found on session 51 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5347226b-603a-4916-87aa-25ccc8fac456]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:19:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:00 user nova-compute[70594]: INFO nova.compute.manager [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Terminating instance
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-952d66a3-47f2-4a59-8369-6229d5417da6 req-b60cf708-7608-482f-bf01-3d6284ac54df service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-vif-unplugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-952d66a3-47f2-4a59-8369-6229d5417da6 req-b60cf708-7608-482f-bf01-3d6284ac54df service nova] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-952d66a3-47f2-4a59-8369-6229d5417da6 req-b60cf708-7608-482f-bf01-3d6284ac54df service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-952d66a3-47f2-4a59-8369-6229d5417da6 req-b60cf708-7608-482f-bf01-3d6284ac54df service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-952d66a3-47f2-4a59-8369-6229d5417da6 req-b60cf708-7608-482f-bf01-3d6284ac54df service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] No waiting events found dispatching network-vif-unplugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-952d66a3-47f2-4a59-8369-6229d5417da6 req-b60cf708-7608-482f-bf01-3d6284ac54df service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-vif-unplugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:20:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Instance destroyed successfully.
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.objects.instance [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lazy-loading 'resources' on Instance uuid 6d000228-a585-4c95-af6d-d9b2d8b35993 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-858073640',display_name='tempest-VolumesActionsTest-instance-858073640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-858073640',id=42,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b13118c340f4eaabfbdc079710d7f4b',ramdisk_id='',reservation_id='r-5i6tevhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-498904371',owner_user_name='tempest-VolumesActionsTest-498904371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:18:16Z,user_data=None,user_id='f8c2f0388cd44ee0a70d339848c959ce',uuid=6d000228-a585-4c95-af6d-d9b2d8b35993,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converting VIF {"id": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "address": "fa:16:3e:94:b5:4b", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b20275-f5", "ovs_interfaceid": "42b20275-f53b-46bf-8c3d-4d47bc447fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG os_vif [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b20275-f5, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:00 user nova-compute[70594]: INFO os_vif [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=42b20275-f53b-46bf-8c3d-4d47bc447fbd,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b20275-f5')
Jul 26 17:20:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Deleting instance files /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993_del
Jul 26 17:20:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Deletion of /opt/stack/data/nova/instances/6d000228-a585-4c95-af6d-d9b2d8b35993_del complete
Jul 26 17:20:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahlskVcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26330643862663839', 'path': '/dev/sdf'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330643862663839', 'path': '/dev/sdf'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'flavor' on Instance uuid 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:20:00 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:20:00 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:20:00 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:20:00 user nova-compute[70594]:   <serial>8d400f9e-6992-49ed-8d50-9e514fc38d20</serial>
Jul 26 17:20:00 user nova-compute[70594]: </disk>
Jul 26 17:20:00 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:20:01 user nova-compute[70594]: INFO nova.compute.manager [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 26 17:20:01 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] No VIF found with MAC fa:16:3e:51:98:df, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2e067073-fe96-4bfb-b45e-d0e99d6186d0 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.719s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:01 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Took 0.54 seconds to deallocate network for instance.
Jul 26 17:20:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:20:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:01 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Deleted allocations for instance 6d000228-a585-4c95-af6d-d9b2d8b35993
Jul 26 17:20:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-42e4040d-2f66-46fb-9097-5caf36d25c78 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.891s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] Acquiring lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] Lock "6d000228-a585-4c95-af6d-d9b2d8b35993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] No waiting events found dispatching network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:02 user nova-compute[70594]: WARNING nova.compute.manager [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received unexpected event network-vif-plugged-42b20275-f53b-46bf-8c3d-4d47bc447fbd for instance with vm_state deleted and task_state None.
Jul 26 17:20:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-a3567461-2a64-4901-9b6f-e71cc62d9664 req-fa148cea-e78e-4468-8901-050ba3de9a16 service nova] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Received event network-vif-deleted-42b20275-f53b-46bf-8c3d-4d47bc447fbd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:03 user nova-compute[70594]: INFO nova.compute.manager [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Detaching volume 8d400f9e-6992-49ed-8d50-9e514fc38d20
Jul 26 17:20:03 user nova-compute[70594]: INFO nova.virt.block_device [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Attempting to driver detach volume 8d400f9e-6992-49ed-8d50-9e514fc38d20 from mountpoint /dev/vdb
Jul 26 17:20:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Attempting to detach device vdb from instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:20:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:20:03 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:20:03 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:20:03 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:20:03 user nova-compute[70594]:   <serial>8d400f9e-6992-49ed-8d50-9e514fc38d20</serial>
Jul 26 17:20:03 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:20:03 user nova-compute[70594]: </disk>
Jul 26 17:20:03 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:20:03 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully detached device vdb from instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 from the persistent domain config.
Jul 26 17:20:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:20:03 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:20:03 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:20:03 user nova-compute[70594]:   <source dev="/dev/sdf"/>
Jul 26 17:20:03 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:20:03 user nova-compute[70594]:   <serial>8d400f9e-6992-49ed-8d50-9e514fc38d20</serial>
Jul 26 17:20:03 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:20:03 user nova-compute[70594]: </disk>
Jul 26 17:20:03 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690392004.0383496, 39b9457c-e7cd-46d2-99a1-8514560c6a02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:20:04 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully detached device vdb from instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 from the live domain config.
Jul 26 17:20:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahlskVcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:20:04 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe3937-c578-4beb-8c99-4aaddce39c69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:20:04 user nova-compute[70594]: No targets found.
Jul 26 17:20:04 user nova-compute[70594]: iSNS:
Jul 26 17:20:04 user nova-compute[70594]: No targets found.
Jul 26 17:20:04 user nova-compute[70594]: STATIC:
Jul 26 17:20:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:20:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:20:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:20:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20
Jul 26 17:20:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:04 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056
Jul 26 17:20:04 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:04 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:04 user nova-compute[70594]: FIRMWARE:
Jul 26 17:20:04 user nova-compute[70594]: No targets found.
Jul 26 17:20:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:20:04 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:20:04 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f3245-5a4f-4be0-887b-c4d713d1a4cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5258f3b1-5b9f-4659-88ee-dec8d9f56d6f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 (non-flash)
Jul 26 17:20:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5900505510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20'): ({'sdf'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Removing single pathed devices sdf {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8215152-cf38-4ece-b4bf-e5befe6bd477]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f191f-9b6e-4157-b353-7cea0ca8ae38]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Flushing IO for device /dev/sdf {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5824517c-4995-4fda-9a7b-3dc7b8738dad]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa39c71-8d03-42c2-8664-3ecca73f84ae]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] SCSI volumes sdf have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbad9af-4bc6-4b9a-80cc-89d70f0e5311]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05e84e-553c-4d35-95f6-cb6d88aaddce]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260]
Jul 26 17:20:04 user nova-compute[70594]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20, portal: 172.16.0.220,3260] successful.
Jul 26 17:20:04 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d400f9e-6992-49ed-8d50-9e514fc38d20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f9e7f-70f9-41aa-95de-8d2a7ce9c9da]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] <== disconnect_volume: return (322ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:04 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:20:05 user nova-compute[70594]: DEBUG nova.objects.instance [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'flavor' on Instance uuid 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-00e454ae-a5d4-4621-a07b-4cd9241c1ab5 tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:11 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:14 user nova-compute[70594]: INFO nova.compute.manager [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Terminating instance
Jul 26 17:20:14 user nova-compute[70594]: DEBUG nova.compute.manager [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-2429711e-6528-4465-a15c-fed7afbd5dd8 req-ea22399f-56a2-4d47-929a-4f7992ba99d4 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2429711e-6528-4465-a15c-fed7afbd5dd8 req-ea22399f-56a2-4d47-929a-4f7992ba99d4 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2429711e-6528-4465-a15c-fed7afbd5dd8 req-ea22399f-56a2-4d47-929a-4f7992ba99d4 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2429711e-6528-4465-a15c-fed7afbd5dd8 req-ea22399f-56a2-4d47-929a-4f7992ba99d4 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-2429711e-6528-4465-a15c-fed7afbd5dd8 req-ea22399f-56a2-4d47-929a-4f7992ba99d4 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.compute.manager [req-2429711e-6528-4465-a15c-fed7afbd5dd8 req-ea22399f-56a2-4d47-929a-4f7992ba99d4 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-unplugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:20:15 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Instance destroyed successfully.
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.objects.instance [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'resources' on Instance uuid 8ef02326-71b1-43ca-a53d-c2f73b049896 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-252829452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-252829452',id=21,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:06:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-0zmjpmej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:08:16Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=8ef02326-71b1-43ca-a53d-c2f73b049896,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "address": "fa:16:3e:d4:b7:0b", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62446ba5-f5", "ovs_interfaceid": "62446ba5-f54c-433c-91c2-b5f430eccc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_vif [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62446ba5-f5, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:20:15 user nova-compute[70594]: INFO os_vif [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:b7:0b,bridge_name='br-int',has_traffic_filtering=True,id=62446ba5-f54c-433c-91c2-b5f430eccc3a,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62446ba5-f5')
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEjVCymI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:20:15 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7b3f1-5165-4c13-870f-54fe8468a0bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:20:15 user nova-compute[70594]: No targets found.
Jul 26 17:20:15 user nova-compute[70594]: iSNS:
Jul 26 17:20:15 user nova-compute[70594]: No targets found.
Jul 26 17:20:15 user nova-compute[70594]: STATIC:
Jul 26 17:20:15 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560
Jul 26 17:20:15 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:15 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:15 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:20:15 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:15 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:15 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:20:15 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:15 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:15 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056
Jul 26 17:20:15 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:15 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:15 user nova-compute[70594]: FIRMWARE:
Jul 26 17:20:15 user nova-compute[70594]: No targets found.
Jul 26 17:20:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:20:15 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:20:15 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[396cdc57-a765-41b0-8ec4-f20d342833c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cdba34-1d8a-49ee-9249-13449461eb85]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:20:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910310670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560'): ({'sdb'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Removing single pathed devices sdb {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6c1a1-1028-41c5-bb79-94ae9973e0b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eefe34-73d6-48e9-9e43-b24e2b4ba8fb]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Flushing IO for device /dev/sdb {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f1b1c4-3a2b-4e14-9df5-8a817c33c775]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.102s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49dd60-251c-40b4-966e-2c29fddd14fd]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[007999ca-52ed-4315-b98f-ba4cbb34935f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392000.8997872, 6d000228-a585-4c95-af6d-d9b2d8b35993 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:20:15 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] VM Stopped (Lifecycle Event)
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a79184-aec1-443d-a57a-ca300245b2ba]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260]
Jul 26 17:20:15 user nova-compute[70594]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560, portal: 172.16.0.220,3260] successful.
Jul 26 17:20:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1d37fee2-732c-49f0-b7c3-c7565a60c124 None None] [instance: 6d000228-a585-4c95-af6d-d9b2d8b35993] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55b56260-a269-4ce7-9398-b195ced9b560 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5cb3f2-4f17-40f6-8fa5-ff14ac79a1fc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] <== disconnect_volume: return (374ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:20:15 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Deleting instance files /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896_del
Jul 26 17:20:15 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Deletion of /opt/stack/data/nova/instances/8ef02326-71b1-43ca-a53d-c2f73b049896_del complete
Jul 26 17:20:15 user nova-compute[70594]: INFO nova.compute.manager [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 26 17:20:15 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:20:15 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:16 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Took 0.49 seconds to deallocate network for instance.
Jul 26 17:20:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-561815ad-9d75-4bd3-93d1-350294da95d4 req-63b29b24-080c-4fa8-879c-55d286361ec8 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-deleted-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:20:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-a4ef2fa5-2cb2-490c-a66b-e4cf96c34b1d req-24136966-8530-4572-ba69-51f8669cb750 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a4ef2fa5-2cb2-490c-a66b-e4cf96c34b1d req-24136966-8530-4572-ba69-51f8669cb750 service nova] Acquiring lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a4ef2fa5-2cb2-490c-a66b-e4cf96c34b1d req-24136966-8530-4572-ba69-51f8669cb750 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a4ef2fa5-2cb2-490c-a66b-e4cf96c34b1d req-24136966-8530-4572-ba69-51f8669cb750 service nova] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-a4ef2fa5-2cb2-490c-a66b-e4cf96c34b1d req-24136966-8530-4572-ba69-51f8669cb750 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] No waiting events found dispatching network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:17 user nova-compute[70594]: WARNING nova.compute.manager [req-a4ef2fa5-2cb2-490c-a66b-e4cf96c34b1d req-24136966-8530-4572-ba69-51f8669cb750 service nova] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Received unexpected event network-vif-plugged-62446ba5-f54c-433c-91c2-b5f430eccc3a for instance with vm_state active and task_state deleting.
Jul 26 17:20:17 user nova-compute[70594]: INFO nova.compute.manager [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Took 0.78 seconds to detach 1 volumes for instance.
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:17 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Deleted allocations for instance 8ef02326-71b1-43ca-a53d-c2f73b049896
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-cfb601d7-ea90-467a-ab3a-95571a71be00 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "8ef02326-71b1-43ca-a53d-c2f73b049896" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:20:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:20:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=25.076446533203125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 70df069f-5f6c-4463-aa0d-4a323de18b10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 39b9457c-e7cd-46d2-99a1-8514560c6a02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 54148d5d-469e-4bc5-b533-fed00053bdcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:20:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:20 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:20 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:20 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:20 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:20 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:20:23 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updating instance_info_cache with network_info: [{"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-00db1375-a1ef-4f03-a7ed-00f75f3e12c6" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:20:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:20:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:30 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392015.5217872, 8ef02326-71b1-43ca-a53d-c2f73b049896 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:20:30 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] VM Stopped (Lifecycle Event)
Jul 26 17:20:30 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8dc53087-072c-4a44-9416-0507bf6c1540 None None] [instance: 8ef02326-71b1-43ca-a53d-c2f73b049896] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:20:30 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:32 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-changed-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Refreshing instance network info cache due to event network-changed-26a83df4-786b-458d-9db2-e73bf9e07d71. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:20:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] Acquiring lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:20:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] Acquired lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:20:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Refreshing network info cache for port 26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG nova.network.neutron [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updated VIF entry in instance network info cache for port 26a83df4-786b-458d-9db2-e73bf9e07d71. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG nova.network.neutron [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updating instance_info_cache with network_info: [{"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-26146920-2c79-44ac-b94c-e8a4ca980b3a req-1432509f-bf17-4e01-8242-1b33e8ec33b6 service nova] Releasing lock "refresh_cache-08bc58e4-d6b2-493a-9d0f-ff43546997bc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:40 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:20:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:45 user nova-compute[70594]: INFO nova.compute.manager [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Attaching volume 024fae51-e09c-427e-b397-0940bee54cc6 to /dev/vdb
Jul 26 17:20:45 user nova-compute[70594]: DEBUG os_brick.utils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d37ffa-eef1-4884-ae75-1fd68bff2567]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa33f3-cfa9-4b08-ab79-cce9bd335a38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc04f8c-7840-44c8-a005-7ca546e5eaca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe65ead8-096d-40a4-a336-25b83ffd16d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:20:45 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:20:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd58498-5110-4453-9d69-4143702a4e84]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG os_brick.utils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updating existing volume attachment record: b76009f7-23c3-4278-80f4-f273b2b0fe6e {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:20:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-changed-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:49 user nova-compute[70594]: DEBUG nova.compute.manager [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Refreshing instance network info cache due to event network-changed-86fd1d90-91c7-4794-85e7-befdf76db1a6. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:20:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] Acquiring lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:20:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] Acquired lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:20:49 user nova-compute[70594]: DEBUG nova.network.neutron [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Refreshing network info cache for port 86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:50 user nova-compute[70594]: INFO nova.compute.manager [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Terminating instance
Jul 26 17:20:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updated VIF entry in instance network info cache for port 86fd1d90-91c7-4794-85e7-befdf76db1a6. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updating instance_info_cache with network_info: [{"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c095bbc3-bc25-4c58-8fe3-bdb4351f232e req-25060cfd-0162-4b14-8b7a-47793fa56a42 service nova] Releasing lock "refresh_cache-54148d5d-469e-4bc5-b533-fed00053bdcc" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-b0614f5f-c445-45e7-a40e-00e01a610965 req-5e7d2f62-5950-4a2d-a3ac-13e3c0fe716e service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-vif-unplugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b0614f5f-c445-45e7-a40e-00e01a610965 req-5e7d2f62-5950-4a2d-a3ac-13e3c0fe716e service nova] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b0614f5f-c445-45e7-a40e-00e01a610965 req-5e7d2f62-5950-4a2d-a3ac-13e3c0fe716e service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b0614f5f-c445-45e7-a40e-00e01a610965 req-5e7d2f62-5950-4a2d-a3ac-13e3c0fe716e service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-b0614f5f-c445-45e7-a40e-00e01a610965 req-5e7d2f62-5950-4a2d-a3ac-13e3c0fe716e service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] No waiting events found dispatching network-vif-unplugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.compute.manager [req-b0614f5f-c445-45e7-a40e-00e01a610965 req-5e7d2f62-5950-4a2d-a3ac-13e3c0fe716e service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-vif-unplugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:20:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Instance destroyed successfully.
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.objects.instance [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'resources' on Instance uuid 54148d5d-469e-4bc5-b533-fed00053bdcc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-256645042',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-256645042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-256645042',id=44,image_ref='8a81205b-23b4-46d6-b918-70bdab528f1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzmi9dCTh04Llvv0PHv5P/QGDfidFe22m3CJ5LgfuL6RLIdT8kQBOEjoClXKLzpHwiTrenqzkJu/bs4lrw7H3PJyJBErZ3vG/pQudYZDz84rxDc/vOFvmxM7SsRQzH7Ew==',key_name='tempest-keypair-1262621850',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:19:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-lib24rxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-491432484',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:19:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=54148d5d-469e-4bc5-b533-fed00053bdcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "address": "fa:16:3e:d9:a7:b1", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86fd1d90-91", "ovs_interfaceid": "86fd1d90-91c7-4794-85e7-befdf76db1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_vif [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86fd1d90-91, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:20:51 user nova-compute[70594]: INFO os_vif [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:a7:b1,bridge_name='br-int',has_traffic_filtering=True,id=86fd1d90-91c7-4794-85e7-befdf76db1a6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86fd1d90-91')
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'udmlAFwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:20:51 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f588323-12cb-4460-b077-08111ea14113]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:20:51 user nova-compute[70594]: No targets found.
Jul 26 17:20:51 user nova-compute[70594]: iSNS:
Jul 26 17:20:51 user nova-compute[70594]: No targets found.
Jul 26 17:20:51 user nova-compute[70594]: STATIC:
Jul 26 17:20:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:20:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:20:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:51 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056
Jul 26 17:20:51 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:51 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:51 user nova-compute[70594]: FIRMWARE:
Jul 26 17:20:51 user nova-compute[70594]: No targets found.
Jul 26 17:20:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:20:51 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:20:51 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278aaa5-52f3-47f4-99ff-a3d048b33a2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[183dea00-03b3-4de9-b94f-b9c1ab05a2c2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:51 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:51 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:20:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:51 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:51 user nova-compute[70594]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 (non-flash)
Jul 26 17:20:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591830e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb91da24-4d73-41d6-a166-c89b92e06f32]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d157e1e-a9bc-43af-b46a-1c9d7bbcc9a8]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0bf593-012f-4258-a402-68099c2f1fd4]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5efbb1-4aec-4042-9286-6af46470b2d9]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26564643661376335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_713c4481', '/dev/disk/by-id/scsi-1SCST_BIO713c4481-edd6a7c5da0f4742') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:20:51 user nova-compute[70594]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26564643661376335
Jul 26 17:20:51 user nova-compute[70594]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_713c4481
Jul 26 17:20:51 user nova-compute[70594]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO713c4481-edd6a7c5da0f4742
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54295667-6eb5-4621-8650-a0d9ab47640d]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e57b2d8-40ab-4b08-a389-12631bbe6396]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37da7271-bd1d-4e7d-b2c6-786e8c09d7f0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260]
Jul 26 17:20:51 user nova-compute[70594]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056, portal: 172.16.0.220,3260] successful.
Jul 26 17:20:51 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:368cfd87-1308-4676-bf9a-d2fdcb835056 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2180779-a668-4162-8c08-cec8596195b0]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== disconnect_volume: return (359ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:20:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Deleting instance files /opt/stack/data/nova/instances/54148d5d-469e-4bc5-b533-fed00053bdcc_del
Jul 26 17:20:51 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Deletion of /opt/stack/data/nova/instances/54148d5d-469e-4bc5-b533-fed00053bdcc_del complete
Jul 26 17:20:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:51 user nova-compute[70594]: INFO nova.compute.manager [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 26 17:20:51 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:20:51 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oiuXdvsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:20:52 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:20:52 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:20:52 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4375fad-e74d-413d-b7d4-d326ed536473]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:20:52 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e780ac3-bcbe-455e-b5ba-0365a63b1533]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6] added
Jul 26 17:20:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f444dd-28eb-4362-896a-887d999d2a3c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f51a0-3425-41b6-9585-b214394c6672]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oiuXdvsS {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oiuXdvsS" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a95d790-6cb9-4341-b08f-d5aeb745a358]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oiuXdvsS'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1dc22-00c2-4de8-8cb9-f1d977d5427a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a756e1-98f7-4050-8836-66b60b699cba]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5340de77-cbc5-4f12-8146-e6909520abd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260]
Jul 26 17:20:52 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260] successful.
Jul 26 17:20:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf52b1-3b38-46b0-bf9c-5d4d37fea66c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc38ac-9c57-4b66-abd3-404128bff043]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 (non-flash)
Jul 26 17:20:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca2d19e-0477-4caf-a6b4-1de5b8c44af1]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "d342176c-025e-416b-82a8-70fee04448eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:20:53 user nova-compute[70594]: INFO nova.compute.claims [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Claim successful on node user
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-f8ff4a8f-6280-4821-b579-f5df80d2a695 req-67186b12-b25d-477e-a7b3-e34d07780225 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f8ff4a8f-6280-4821-b579-f5df80d2a695 req-67186b12-b25d-477e-a7b3-e34d07780225 service nova] Acquiring lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f8ff4a8f-6280-4821-b579-f5df80d2a695 req-67186b12-b25d-477e-a7b3-e34d07780225 service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f8ff4a8f-6280-4821-b579-f5df80d2a695 req-67186b12-b25d-477e-a7b3-e34d07780225 service nova] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.manager [req-f8ff4a8f-6280-4821-b579-f5df80d2a695 req-67186b12-b25d-477e-a7b3-e34d07780225 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] No waiting events found dispatching network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:53 user nova-compute[70594]: WARNING nova.compute.manager [req-f8ff4a8f-6280-4821-b579-f5df80d2a695 req-67186b12-b25d-477e-a7b3-e34d07780225 service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received unexpected event network-vif-plugged-86fd1d90-91c7-4794-85e7-befdf76db1a6 for instance with vm_state active and task_state deleting.
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oiuXdvsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26331376430366337', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331376430366337', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:20:53 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Took 1.83 seconds to deallocate network for instance.
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.objects.instance [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:20:53 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:20:53 user nova-compute[70594]:   <source dev="/dev/sdb"/>
Jul 26 17:20:53 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:20:53 user nova-compute[70594]:   <serial>024fae51-e09c-427e-b397-0940bee54cc6</serial>
Jul 26 17:20:53 user nova-compute[70594]: </disk>
Jul 26 17:20:53 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:20:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.policy [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8c2f0388cd44ee0a70d339848c959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b13118c340f4eaabfbdc079710d7f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:20:53 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Creating image(s)
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "/opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "/opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "/opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:20:53 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] No VIF found with MAC fa:16:3e:5f:0f:ac, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.151s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk 1073741824" returned: 0 in 0.067s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-55f24eed-ea6c-40cf-bf64-1f22a7f5c19c tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.100s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.162s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:54 user nova-compute[70594]: INFO nova.compute.manager [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Took 0.86 seconds to detach 1 volumes for instance.
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Deleting volume: 368cfd87-1308-4676-bf9a-d2fdcb835056 {{(pid=70594) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Cannot resize image /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lazy-loading 'migration_context' on Instance uuid d342176c-025e-416b-82a8-70fee04448eb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Ensure instance console log exists: /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Successfully created port: 9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:54 user nova-compute[70594]: INFO nova.compute.manager [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Terminating instance
Jul 26 17:20:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:20:54 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Deleted allocations for instance 54148d5d-469e-4bc5-b533-fed00053bdcc
Jul 26 17:20:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-748ffc38-8a85-4f4f-809b-14b93f17f8c8 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "54148d5d-469e-4bc5-b533-fed00053bdcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.646s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.compute.manager [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Detaching volume 024fae51-e09c-427e-b397-0940bee54cc6
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Received event network-vif-deleted-86fd1d90-91c7-4794-85e7-befdf76db1a6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-changed-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Refreshing instance network info cache due to event network-changed-f2055bc6-97f4-44b4-80be-962a102a6668. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] Acquiring lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] Acquired lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.network.neutron [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Refreshing network info cache for port f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.virt.block_device [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Attempting to driver detach volume 024fae51-e09c-427e-b397-0940bee54cc6 from mountpoint /dev/vdb
Jul 26 17:20:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Attempting to detach device vdb from instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:20:55 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:20:55 user nova-compute[70594]:   <source dev="/dev/sdb"/>
Jul 26 17:20:55 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:20:55 user nova-compute[70594]:   <serial>024fae51-e09c-427e-b397-0940bee54cc6</serial>
Jul 26 17:20:55 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:20:55 user nova-compute[70594]: </disk>
Jul 26 17:20:55 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully detached device vdb from instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc from the persistent domain config.
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:20:55 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:20:55 user nova-compute[70594]:   <source dev="/dev/sdb"/>
Jul 26 17:20:55 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:20:55 user nova-compute[70594]:   <serial>024fae51-e09c-427e-b397-0940bee54cc6</serial>
Jul 26 17:20:55 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:20:55 user nova-compute[70594]: </disk>
Jul 26 17:20:55 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-97514d27-ea07-4272-a3fb-5ff24ca5ba16 req-4d3af56f-9c73-4567-b1e6-0343989359fa service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-vif-unplugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-97514d27-ea07-4272-a3fb-5ff24ca5ba16 req-4d3af56f-9c73-4567-b1e6-0343989359fa service nova] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-97514d27-ea07-4272-a3fb-5ff24ca5ba16 req-4d3af56f-9c73-4567-b1e6-0343989359fa service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-97514d27-ea07-4272-a3fb-5ff24ca5ba16 req-4d3af56f-9c73-4567-b1e6-0343989359fa service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-97514d27-ea07-4272-a3fb-5ff24ca5ba16 req-4d3af56f-9c73-4567-b1e6-0343989359fa service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] No waiting events found dispatching network-vif-unplugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-97514d27-ea07-4272-a3fb-5ff24ca5ba16 req-4d3af56f-9c73-4567-b1e6-0343989359fa service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-vif-unplugged-f2055bc6-97f4-44b4-80be-962a102a6668 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690392055.9065523, 08bc58e4-d6b2-493a-9d0f-ff43546997bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully detached device vdb from instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc from the live domain config.
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oiuXdvsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:20:55 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Instance destroyed successfully.
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'resources' on Instance uuid 39b9457c-e7cd-46d2-99a1-8514560c6a02 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-262031580',display_name='tempest-TestStampPattern-server-262031580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-262031580',id=41,image_ref='553f6d35-dbb4-41a1-b76b-97d76b74a4a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuU9vkRiUUY91H5G4dksku7YGxgAoLoORaB/v72MwRrgyh8Fg/Vdg35Djak3dez1Rc5MS6C6T9oWoKIMJP3KiX73yatqrHOUDzXbKpDFoqQWisLjqlFn8Tb0pNMuGOcTA==',key_name='tempest-TestStampPattern-1443624212',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:18:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef56c4a969bf4c7ea298d511ccda8490',ramdisk_id='',reservation_id='r-fl45yyha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e3deb93d-2ad8-45fa-91f1-68d48dea5637',image_min_disk='1',image_min_ram='0',image_owner_id='ef56c4a969bf4c7ea298d511ccda8490',image_owner_project_name='tempest-TestStampPattern-1856485652',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1856485652-project-member',image_user_id='1b7e2843bba8470eb36bd37c721c7972',owner_project_name='tempest-TestStampPattern-1856485652',owner_user_name='tempest-TestStampPattern-1856485652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:18:07Z,user_data=None,user_id='1b7e2843bba8470eb36bd37c721c7972',uuid=39b9457c-e7cd-46d2-99a1-8514560c6a02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converting VIF {"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_vif [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2055bc6-97, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ac4d6-2606-4ee7-878f-07ad17f9ee40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:20:55 user nova-compute[70594]: No targets found.
Jul 26 17:20:55 user nova-compute[70594]: iSNS:
Jul 26 17:20:55 user nova-compute[70594]: No targets found.
Jul 26 17:20:55 user nova-compute[70594]: STATIC:
Jul 26 17:20:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:20:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:20:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:55 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6
Jul 26 17:20:55 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:20:55 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:20:55 user nova-compute[70594]: FIRMWARE:
Jul 26 17:20:55 user nova-compute[70594]: No targets found.
Jul 26 17:20:55 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:20:55 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:20:55 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:55 user nova-compute[70594]: INFO os_vif [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:98:df,bridge_name='br-int',has_traffic_filtering=True,id=f2055bc6-97f4-44b4-80be-962a102a6668,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2055bc6-97')
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Deleting instance files /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02_del
Jul 26 17:20:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Deletion of /opt/stack/data/nova/instances/39b9457c-e7cd-46d2-99a1-8514560c6a02_del complete
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51189591-1452-455b-adbc-fd4fb96c65b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:55 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updated VIF entry in instance network info cache for port f2055bc6-97f4-44b4-80be-962a102a6668. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updating instance_info_cache with network_info: [{"id": "f2055bc6-97f4-44b4-80be-962a102a6668", "address": "fa:16:3e:51:98:df", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2055bc6-97", "ovs_interfaceid": "f2055bc6-97f4-44b4-80be-962a102a6668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ca989-83b8-4844-9ce6-52c99e4d8ab5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:56 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:56 user nova-compute[70594]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 (non-flash)
Jul 26 17:20:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:20:56 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:20:56 user nova-compute[70594]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 (non-flash)
Jul 26 17:20:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591b360040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6'): ({'sdb'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Removing single pathed devices sdb {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2864ccff-b1f3-4865-99ab-13c03054ed3c req-2a8f2a2f-1243-4465-878a-e687fee46f2a service nova] Releasing lock "refresh_cache-39b9457c-e7cd-46d2-99a1-8514560c6a02" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: INFO nova.compute.manager [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ff052-2008-46e5-a704-1a90f691e7f1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b7001-7e85-44ed-ad96-eda7dec86026]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Flushing IO for device /dev/sdb {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74897f3-9ca2-4e23-8015-54bd1ff9a140]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bee876-d27c-4d63-a5d8-4bbab39d92d4]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b514d2e1-0b33-4bf2-bd01-ee1e87b47301]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1c9ee-c73d-4ca3-8be1-7938b0f049c0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260]
Jul 26 17:20:56 user nova-compute[70594]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6, portal: 172.16.0.220,3260] successful.
Jul 26 17:20:56 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:024fae51-e09c-427e-b397-0940bee54cc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0b25e9-8c3a-4b77-8afe-8e0a34a6ebc2]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] <== disconnect_volume: return (384ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Successfully updated port: 9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "refresh_cache-d342176c-025e-416b-82a8-70fee04448eb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquired lock "refresh_cache-d342176c-025e-416b-82a8-70fee04448eb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:56 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Took 0.65 seconds to deallocate network for instance.
Jul 26 17:20:56 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'flavor' on Instance uuid 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-052d5656-6c7c-4c0f-8f98-21bac1ae54f1 tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.076s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:57 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Deleted allocations for instance 39b9457c-e7cd-46d2-99a1-8514560c6a02
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b41d8b2-f12c-4a07-a84f-9dd3dca0966e tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-64a6a4c6-8f51-4fa7-8e17-0112ef78da9f req-747144e1-e1b8-407d-a0c6-66aaa8bc941c service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-64a6a4c6-8f51-4fa7-8e17-0112ef78da9f req-747144e1-e1b8-407d-a0c6-66aaa8bc941c service nova] Acquiring lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-64a6a4c6-8f51-4fa7-8e17-0112ef78da9f req-747144e1-e1b8-407d-a0c6-66aaa8bc941c service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-64a6a4c6-8f51-4fa7-8e17-0112ef78da9f req-747144e1-e1b8-407d-a0c6-66aaa8bc941c service nova] Lock "39b9457c-e7cd-46d2-99a1-8514560c6a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-64a6a4c6-8f51-4fa7-8e17-0112ef78da9f req-747144e1-e1b8-407d-a0c6-66aaa8bc941c service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] No waiting events found dispatching network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:57 user nova-compute[70594]: WARNING nova.compute.manager [req-64a6a4c6-8f51-4fa7-8e17-0112ef78da9f req-747144e1-e1b8-407d-a0c6-66aaa8bc941c service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received unexpected event network-vif-plugged-f2055bc6-97f4-44b4-80be-962a102a6668 for instance with vm_state deleted and task_state None.
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.network.neutron [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Updating instance_info_cache with network_info: [{"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Releasing lock "refresh_cache-d342176c-025e-416b-82a8-70fee04448eb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Instance network_info: |[{"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Start _get_guest_xml network_info=[{"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:20:57 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:20:57 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1833416724',display_name='tempest-VolumesActionsTest-instance-1833416724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1833416724',id=45,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b13118c340f4eaabfbdc079710d7f4b',ramdisk_id='',reservation_id='r-csgoytf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-498904371',owner_user_name='tempest-VolumesActionsTest-498904371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:20:54Z,user_data=None,user_id='f8c2f0388cd44ee0a70d339848c959ce',uuid=d342176c-025e-416b-82a8-70fee04448eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converting VIF {"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lazy-loading 'pci_devices' on Instance uuid d342176c-025e-416b-82a8-70fee04448eb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-changed-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Refreshing instance network info cache due to event network-changed-9789a7f3-c09d-4f7f-90f1-3f330e24f19c. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] Acquiring lock "refresh_cache-d342176c-025e-416b-82a8-70fee04448eb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] Acquired lock "refresh_cache-d342176c-025e-416b-82a8-70fee04448eb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.network.neutron [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Refreshing network info cache for port 9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:20:57 user nova-compute[70594]:   <uuid>d342176c-025e-416b-82a8-70fee04448eb</uuid>
Jul 26 17:20:57 user nova-compute[70594]:   <name>instance-0000002d</name>
Jul 26 17:20:57 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:20:57 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:20:57 user nova-compute[70594]:   <metadata>
Jul 26 17:20:57 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:20:57 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:20:57 user nova-compute[70594]:       <nova:name>tempest-VolumesActionsTest-instance-1833416724</nova:name>
Jul 26 17:20:57 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:20:57</nova:creationTime>
Jul 26 17:20:57 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:20:57 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:20:57 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:20:57 user nova-compute[70594]:       <nova:owner>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:user uuid="f8c2f0388cd44ee0a70d339848c959ce">tempest-VolumesActionsTest-498904371-project-member</nova:user>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:project uuid="9b13118c340f4eaabfbdc079710d7f4b">tempest-VolumesActionsTest-498904371</nova:project>
Jul 26 17:20:57 user nova-compute[70594]:       </nova:owner>
Jul 26 17:20:57 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:20:57 user nova-compute[70594]:       <nova:ports>
Jul 26 17:20:57 user nova-compute[70594]:         <nova:port uuid="9789a7f3-c09d-4f7f-90f1-3f330e24f19c">
Jul 26 17:20:57 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 26 17:20:57 user nova-compute[70594]:         </nova:port>
Jul 26 17:20:57 user nova-compute[70594]:       </nova:ports>
Jul 26 17:20:57 user nova-compute[70594]:     </nova:instance>
Jul 26 17:20:57 user nova-compute[70594]:   </metadata>
Jul 26 17:20:57 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:20:57 user nova-compute[70594]:     <system>
Jul 26 17:20:57 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:20:57 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:20:57 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:20:57 user nova-compute[70594]:       <entry name="serial">d342176c-025e-416b-82a8-70fee04448eb</entry>
Jul 26 17:20:57 user nova-compute[70594]:       <entry name="uuid">d342176c-025e-416b-82a8-70fee04448eb</entry>
Jul 26 17:20:57 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:20:57 user nova-compute[70594]:     </system>
Jul 26 17:20:57 user nova-compute[70594]:   </sysinfo>
Jul 26 17:20:57 user nova-compute[70594]:   <os>
Jul 26 17:20:57 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:20:57 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:20:57 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:20:57 user nova-compute[70594]:   </os>
Jul 26 17:20:57 user nova-compute[70594]:   <features>
Jul 26 17:20:57 user nova-compute[70594]:     <acpi/>
Jul 26 17:20:57 user nova-compute[70594]:     <apic/>
Jul 26 17:20:57 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:20:57 user nova-compute[70594]:   </features>
Jul 26 17:20:57 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:20:57 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:20:57 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:20:57 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:20:57 user nova-compute[70594]:   </clock>
Jul 26 17:20:57 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:20:57 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:20:57 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:20:57 user nova-compute[70594]:   </cpu>
Jul 26 17:20:57 user nova-compute[70594]:   <devices>
Jul 26 17:20:57 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:20:57 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:20:57 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk"/>
Jul 26 17:20:57 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:20:57 user nova-compute[70594]:     </disk>
Jul 26 17:20:57 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:20:57 user nova-compute[70594]:       <mac address="fa:16:3e:17:dd:06"/>
Jul 26 17:20:57 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:20:57 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:20:57 user nova-compute[70594]:       <target dev="tap9789a7f3-c0"/>
Jul 26 17:20:57 user nova-compute[70594]:     </interface>
Jul 26 17:20:57 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:20:57 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/console.log" append="off"/>
Jul 26 17:20:57 user nova-compute[70594]:     </serial>
Jul 26 17:20:57 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:20:57 user nova-compute[70594]:     <video>
Jul 26 17:20:57 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:20:57 user nova-compute[70594]:     </video>
Jul 26 17:20:57 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:20:57 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:20:57 user nova-compute[70594]:     </rng>
Jul 26 17:20:57 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:20:57 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:20:57 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:20:57 user nova-compute[70594]:     </memballoon>
Jul 26 17:20:57 user nova-compute[70594]:   </devices>
Jul 26 17:20:57 user nova-compute[70594]: </domain>
Jul 26 17:20:57 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1833416724',display_name='tempest-VolumesActionsTest-instance-1833416724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1833416724',id=45,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b13118c340f4eaabfbdc079710d7f4b',ramdisk_id='',reservation_id='r-csgoytf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-498904371',owner_user_name='tempest-VolumesActionsTest-498904371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:20:54Z,user_data=None,user_id='f8c2f0388cd44ee0a70d339848c959ce',uuid=d342176c-025e-416b-82a8-70fee04448eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converting VIF {"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG os_vif [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9789a7f3-c0, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9789a7f3-c0, col_values=(('external_ids', {'iface-id': '9789a7f3-c09d-4f7f-90f1-3f330e24f19c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:dd:06', 'vm-uuid': 'd342176c-025e-416b-82a8-70fee04448eb'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:57 user nova-compute[70594]: INFO os_vif [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0')
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:20:57 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] No VIF found with MAC fa:16:3e:17:dd:06, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Updated VIF entry in instance network info cache for port 9789a7f3-c09d-4f7f-90f1-3f330e24f19c. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG nova.network.neutron [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Updating instance_info_cache with network_info: [{"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] Releasing lock "refresh_cache-d342176c-025e-416b-82a8-70fee04448eb" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-c8ee981b-1f72-4e1c-90cd-7e08c144236a req-29d17885-37a2-4cef-9ad5-ca75d47f953f service nova] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Received event network-vif-deleted-f2055bc6-97f4-44b4-80be-962a102a6668 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] No waiting events found dispatching network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:59 user nova-compute[70594]: WARNING nova.compute.manager [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received unexpected event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c for instance with vm_state building and task_state spawning.
Jul 26 17:20:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:20:59 user nova-compute[70594]: DEBUG nova.compute.manager [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] No waiting events found dispatching network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:20:59 user nova-compute[70594]: WARNING nova.compute.manager [req-bd848437-0001-4f10-9c2b-e048465a439f req-b30d9066-22b5-48a1-9246-9af06021a8be service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received unexpected event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c for instance with vm_state building and task_state spawning.
Jul 26 17:20:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392061.0666826, d342176c-025e-416b-82a8-70fee04448eb => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] VM Resumed (Lifecycle Event)
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] Instance spawned successfully.
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392061.0723574, d342176c-025e-416b-82a8-70fee04448eb => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] VM Started (Lifecycle Event)
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Took 7.48 seconds to spawn the instance on the hypervisor.
Jul 26 17:21:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:21:01 user nova-compute[70594]: INFO nova.compute.manager [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Took 8.23 seconds to build instance.
Jul 26 17:21:01 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1dff03c9-6cb1-4671-9df8-e095fb9d1d13 tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "d342176c-025e-416b-82a8-70fee04448eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.324s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:02 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:05 user nova-compute[70594]: INFO nova.compute.manager [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Terminating instance
Jul 26 17:21:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-af8161ba-7eac-4511-811e-62d2e3a095f3 req-33aee050-e545-4039-9711-4b34b9ac5b4d service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-vif-unplugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af8161ba-7eac-4511-811e-62d2e3a095f3 req-33aee050-e545-4039-9711-4b34b9ac5b4d service nova] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af8161ba-7eac-4511-811e-62d2e3a095f3 req-33aee050-e545-4039-9711-4b34b9ac5b4d service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-af8161ba-7eac-4511-811e-62d2e3a095f3 req-33aee050-e545-4039-9711-4b34b9ac5b4d service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-af8161ba-7eac-4511-811e-62d2e3a095f3 req-33aee050-e545-4039-9711-4b34b9ac5b4d service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] No waiting events found dispatching network-vif-unplugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.compute.manager [req-af8161ba-7eac-4511-811e-62d2e3a095f3 req-33aee050-e545-4039-9711-4b34b9ac5b4d service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-vif-unplugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392051.141838, 54148d5d-469e-4bc5-b533-fed00053bdcc => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:21:06 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] VM Stopped (Lifecycle Event)
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.compute.manager [None req-dbaf0aa9-54dd-4a01-a35f-087a8d8960f9 None None] [instance: 54148d5d-469e-4bc5-b533-fed00053bdcc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:21:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Instance destroyed successfully.
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.objects.instance [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lazy-loading 'resources' on Instance uuid 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:01:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-101036294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-101036294',id=15,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:01:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d253357a8f7b42119a7b91385afa0e8b',ramdisk_id='',reservation_id='r-k0nluta0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-43751456',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:03:25Z,user_data=None,user_id='f6af9ec8d9d644c89ba32c10861afba2',uuid=00db1375-a1ef-4f03-a7ed-00f75f3e12c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converting VIF {"id": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "address": "fa:16:3e:e2:e2:55", "network": {"id": "7479994f-40a9-4e9f-ac0b-a151302a8fd6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1293291679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d253357a8f7b42119a7b91385afa0e8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12819d23-fd", "ovs_interfaceid": "12819d23-fd02-422e-a30b-7bc1ec5374b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG os_vif [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12819d23-fd, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:06 user nova-compute[70594]: INFO os_vif [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e2:55,bridge_name='br-int',has_traffic_filtering=True,id=12819d23-fd02-422e-a30b-7bc1ec5374b2,network=Network(7479994f-40a9-4e9f-ac0b-a151302a8fd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12819d23-fd')
Jul 26 17:21:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Deleting instance files /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6_del
Jul 26 17:21:06 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Deletion of /opt/stack/data/nova/instances/00db1375-a1ef-4f03-a7ed-00f75f3e12c6_del complete
Jul 26 17:21:06 user nova-compute[70594]: INFO nova.compute.manager [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 26 17:21:06 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:21:06 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:21:06 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Took 0.52 seconds to deallocate network for instance.
Jul 26 17:21:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:07 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:21:07 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:21:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:07 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Deleted allocations for instance 00db1375-a1ef-4f03-a7ed-00f75f3e12c6
Jul 26 17:21:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-98f0eb38-9009-4534-8fe1-0fd3cb342a23 tempest-ServerBootFromVolumeStableRescueTest-43751456 tempest-ServerBootFromVolumeStableRescueTest-43751456-project-member] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] Acquiring lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:08 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] Lock "00db1375-a1ef-4f03-a7ed-00f75f3e12c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] No waiting events found dispatching network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:08 user nova-compute[70594]: WARNING nova.compute.manager [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received unexpected event network-vif-plugged-12819d23-fd02-422e-a30b-7bc1ec5374b2 for instance with vm_state deleted and task_state None.
Jul 26 17:21:08 user nova-compute[70594]: DEBUG nova.compute.manager [req-565cbd2a-9274-4dc2-8187-be0a14396472 req-94c8c6af-d64b-463b-aa40-f6780c5c1877 service nova] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Received event network-vif-deleted-12819d23-fd02-422e-a30b-7bc1ec5374b2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:10 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392055.9163358, 39b9457c-e7cd-46d2-99a1-8514560c6a02 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:21:10 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] VM Stopped (Lifecycle Event)
Jul 26 17:21:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-23b73333-5902-4d84-ad15-23a6aea98324 None None] [instance: 39b9457c-e7cd-46d2-99a1-8514560c6a02] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:21:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:12 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:21:17 user nova-compute[70594]: INFO nova.compute.manager [None req-168c6b8b-8588-4560-8df6-7cb4c32761cd tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Get console output
Jul 26 17:21:17 user nova-compute[70594]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:21:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:21:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:21:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8026MB free_disk=25.172622680664062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance e3deb93d-2ad8-45fa-91f1-68d48dea5637 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 70df069f-5f6c-4463-aa0d-4a323de18b10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d342176c-025e-416b-82a8-70fee04448eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:21:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:21 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392066.3508594, 00db1375-a1ef-4f03-a7ed-00f75f3e12c6 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:21:21 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] VM Stopped (Lifecycle Event)
Jul 26 17:21:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b544fdff-e200-4bfe-a9a2-80af6eba0432 None None] [instance: 00db1375-a1ef-4f03-a7ed-00f75f3e12c6] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:21:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:21:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:21:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:21:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:21:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:21:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [{"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:21:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-6bd16164-caa5-442a-b55c-f84119c36256" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:21:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:21:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:45 user nova-compute[70594]: INFO nova.compute.manager [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Terminating instance
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:45 user nova-compute[70594]: INFO nova.compute.manager [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Terminating instance
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-84b0c2e1-b9e2-4182-882c-1f50cf2a0a77 req-9dd06068-3a00-4e73-936c-e18b2ffcf497 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-unplugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84b0c2e1-b9e2-4182-882c-1f50cf2a0a77 req-9dd06068-3a00-4e73-936c-e18b2ffcf497 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84b0c2e1-b9e2-4182-882c-1f50cf2a0a77 req-9dd06068-3a00-4e73-936c-e18b2ffcf497 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-84b0c2e1-b9e2-4182-882c-1f50cf2a0a77 req-9dd06068-3a00-4e73-936c-e18b2ffcf497 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-84b0c2e1-b9e2-4182-882c-1f50cf2a0a77 req-9dd06068-3a00-4e73-936c-e18b2ffcf497 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-unplugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-84b0c2e1-b9e2-4182-882c-1f50cf2a0a77 req-9dd06068-3a00-4e73-936c-e18b2ffcf497 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-unplugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-2f8dce1b-fd1a-4397-b64d-8b1b3114ce70 req-f0280202-6565-4e70-bcf6-45b538795e69 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-vif-unplugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2f8dce1b-fd1a-4397-b64d-8b1b3114ce70 req-f0280202-6565-4e70-bcf6-45b538795e69 service nova] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2f8dce1b-fd1a-4397-b64d-8b1b3114ce70 req-f0280202-6565-4e70-bcf6-45b538795e69 service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2f8dce1b-fd1a-4397-b64d-8b1b3114ce70 req-f0280202-6565-4e70-bcf6-45b538795e69 service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-2f8dce1b-fd1a-4397-b64d-8b1b3114ce70 req-f0280202-6565-4e70-bcf6-45b538795e69 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] No waiting events found dispatching network-vif-unplugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-2f8dce1b-fd1a-4397-b64d-8b1b3114ce70 req-f0280202-6565-4e70-bcf6-45b538795e69 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-vif-unplugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Instance destroyed successfully.
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.objects.instance [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'resources' on Instance uuid 70df069f-5f6c-4463-aa0d-4a323de18b10 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Instance destroyed successfully.
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lazy-loading 'resources' on Instance uuid 08bc58e4-d6b2-493a-9d0f-ff43546997bc {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-874250262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-874250262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-874250262',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+YFcbvejK3g8V8neDye/1AQXlbMqm45FtKaTQ2K8lr5VPnkh/pVEaPhFbJLi1Xbu52uyS3LwcXPXbsj5TovNLmpMJOhPEylIDEx9GH6HBj7FFYhL34zD6SkNo/1vsEeg==',key_name='tempest-keypair-1042358430',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:17:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-pyg08f44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=70df069f-5f6c-4463-aa0d-4a323de18b10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "address": "fa:16:3e:4c:79:a4", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10397-32", "ovs_interfaceid": "ebd10397-3239-4b56-a47b-5e53ec0ac80d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_vif [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-215846485',display_name='tempest-AttachVolumeNegativeTest-server-215846485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-215846485',id=43,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdB9XpCfrAYp86giPnS11HriHgEVNAJN3FWoGDdCVbn9kM6Fvip7e/QDzRvqYnO3iMV3ufPrSnAtMOdSgwWpapFd1Pxz+k/RBt/GJ6b3QCcpPLG+9HOoI3VgZbp2iNBUw==',key_name='tempest-keypair-1131839349',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b689bf7a7c5049dbac0edae98843930c',ramdisk_id='',reservation_id='r-1sne5ba7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1151062115',owner_user_name='tempest-AttachVolumeNegativeTest-1151062115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7389a1c933cc4c24b20281842b82e83b',uuid=08bc58e4-d6b2-493a-9d0f-ff43546997bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converting VIF {"id": "26a83df4-786b-458d-9db2-e73bf9e07d71", "address": "fa:16:3e:5f:0f:ac", "network": {"id": "7ed51671-cd99-4962-bb48-5ccbb58ee248", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2025834702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b689bf7a7c5049dbac0edae98843930c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a83df4-78", "ovs_interfaceid": "26a83df4-786b-458d-9db2-e73bf9e07d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_vif [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd10397-32, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26a83df4-78, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:21:46 user nova-compute[70594]: INFO os_vif [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:79:a4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10397-3239-4b56-a47b-5e53ec0ac80d,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10397-32')
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSQgZwEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:21:46 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:21:46 user nova-compute[70594]: INFO os_vif [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0f:ac,bridge_name='br-int',has_traffic_filtering=True,id=26a83df4-786b-458d-9db2-e73bf9e07d71,network=Network(7ed51671-cd99-4962-bb48-5ccbb58ee248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a83df4-78')
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Deleting instance files /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc_del
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Deletion of /opt/stack/data/nova/instances/08bc58e4-d6b2-493a-9d0f-ff43546997bc_del complete
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9190207-4aa7-4200-9e9b-df22289a77c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:21:46 user nova-compute[70594]: No targets found.
Jul 26 17:21:46 user nova-compute[70594]: iSNS:
Jul 26 17:21:46 user nova-compute[70594]: No targets found.
Jul 26 17:21:46 user nova-compute[70594]: STATIC:
Jul 26 17:21:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:21:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:21:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:21:46 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64
Jul 26 17:21:46 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:21:46 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:21:46 user nova-compute[70594]: FIRMWARE:
Jul 26 17:21:46 user nova-compute[70594]: No targets found.
Jul 26 17:21:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:21:46 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:21:46 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e846a96-4257-4ac8-866b-4ad6d2dc6c64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.compute.manager [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Took 1.09 seconds to destroy the instance on the hypervisor.
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30d52b5-b395-4630-a746-f0d780e40670]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:21:46 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:21:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 (non-flash)
Jul 26 17:21:46 user nova-compute[70594]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:21:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591830d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64'): ({'sde'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Removing single pathed devices sde {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bfba2-2d76-4c9a-873c-4b6d23ba5803]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56dc7e-3872-4fe1-9d35-6419c3f7ae29]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flushing IO for device /dev/sde {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f35019-7bd9-442b-87ca-8e5d350490c6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[382bac21-1bb9-4ceb-b0b5-204faaa47135]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] SCSI volumes sde have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[45393b82-f010-4599-b56e-b4c5c1d72131]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dae5448-8435-4367-b473-61db3ba9e45e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260]
Jul 26 17:21:46 user nova-compute[70594]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64, portal: 172.16.0.220,3260] successful.
Jul 26 17:21:46 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb1818be-7545-48ac-8df9-acbba4ebbe64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c94f5b-bec9-4657-a3f6-62954137ad12]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== disconnect_volume: return (347ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Deleting instance files /opt/stack/data/nova/instances/70df069f-5f6c-4463-aa0d-4a323de18b10_del
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Deletion of /opt/stack/data/nova/instances/70df069f-5f6c-4463-aa0d-4a323de18b10_del complete
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:46 user nova-compute[70594]: INFO nova.compute.manager [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Took 1.62 seconds to destroy the instance on the hypervisor.
Jul 26 17:21:46 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:21:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:47 user nova-compute[70594]: WARNING nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received unexpected event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with vm_state active and task_state deleting.
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:47 user nova-compute[70594]: WARNING nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received unexpected event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with vm_state active and task_state deleting.
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:47 user nova-compute[70594]: WARNING nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received unexpected event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with vm_state active and task_state deleting.
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-unplugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-unplugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-unplugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Acquiring lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] No waiting events found dispatching network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:47 user nova-compute[70594]: WARNING nova.compute.manager [req-cc9bec95-98a6-4d8a-8715-3b34002af648 req-7a1b48f0-8c6f-464a-9df7-90f76c3d0bc4 service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received unexpected event network-vif-plugged-26a83df4-786b-458d-9db2-e73bf9e07d71 for instance with vm_state active and task_state deleting.
Jul 26 17:21:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-91ac2ba9-1978-4507-b3cd-567c0b9a9abf req-218ea1e0-2edd-4090-b5b2-0450c2dee071 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-91ac2ba9-1978-4507-b3cd-567c0b9a9abf req-218ea1e0-2edd-4090-b5b2-0450c2dee071 service nova] Acquiring lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-91ac2ba9-1978-4507-b3cd-567c0b9a9abf req-218ea1e0-2edd-4090-b5b2-0450c2dee071 service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-91ac2ba9-1978-4507-b3cd-567c0b9a9abf req-218ea1e0-2edd-4090-b5b2-0450c2dee071 service nova] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-91ac2ba9-1978-4507-b3cd-567c0b9a9abf req-218ea1e0-2edd-4090-b5b2-0450c2dee071 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] No waiting events found dispatching network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:48 user nova-compute[70594]: WARNING nova.compute.manager [req-91ac2ba9-1978-4507-b3cd-567c0b9a9abf req-218ea1e0-2edd-4090-b5b2-0450c2dee071 service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received unexpected event network-vif-plugged-ebd10397-3239-4b56-a47b-5e53ec0ac80d for instance with vm_state active and task_state deleting.
Jul 26 17:21:48 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:21:48 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Took 1.86 seconds to deallocate network for instance.
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:21:48 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Took 1.73 seconds to deallocate network for instance.
Jul 26 17:21:48 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:48 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Deleted allocations for instance 08bc58e4-d6b2-493a-9d0f-ff43546997bc
Jul 26 17:21:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f69d5200-a6f4-484c-a63c-f013d53fa9ea tempest-AttachVolumeNegativeTest-1151062115 tempest-AttachVolumeNegativeTest-1151062115-project-member] Lock "08bc58e4-d6b2-493a-9d0f-ff43546997bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.390s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:49 user nova-compute[70594]: INFO nova.compute.manager [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Took 0.89 seconds to detach 1 volumes for instance.
Jul 26 17:21:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Deleting volume: bb1818be-7545-48ac-8df9-acbba4ebbe64 {{(pid=70594) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 26 17:21:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:49 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:21:49 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:21:49 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:49 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Deleted allocations for instance 70df069f-5f6c-4463-aa0d-4a323de18b10
Jul 26 17:21:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-539470da-1d6b-40cd-b9ac-24638f4cd867 req-2030070d-c392-49ad-b90b-424a114319fe service nova] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Received event network-vif-deleted-26a83df4-786b-458d-9db2-e73bf9e07d71 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-539470da-1d6b-40cd-b9ac-24638f4cd867 req-2030070d-c392-49ad-b90b-424a114319fe service nova] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Received event network-vif-deleted-ebd10397-3239-4b56-a47b-5e53ec0ac80d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-013adbb1-5a8e-4ba2-9b76-5e246662bd20 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "70df069f-5f6c-4463-aa0d-4a323de18b10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.727s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-changed-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Refreshing instance network info cache due to event network-changed-1f0c63c5-83d2-4858-aa77-1aabc9be4abd. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] Acquiring lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] Acquired lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.network.neutron [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Refreshing network info cache for port 1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:55 user nova-compute[70594]: INFO nova.compute.manager [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Terminating instance
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-0d58c4f5-805d-4c62-9170-651d6620d44b req-e9e7243c-6101-42bc-9b9d-b3e0a9bffcb9 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-vif-unplugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0d58c4f5-805d-4c62-9170-651d6620d44b req-e9e7243c-6101-42bc-9b9d-b3e0a9bffcb9 service nova] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0d58c4f5-805d-4c62-9170-651d6620d44b req-e9e7243c-6101-42bc-9b9d-b3e0a9bffcb9 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-0d58c4f5-805d-4c62-9170-651d6620d44b req-e9e7243c-6101-42bc-9b9d-b3e0a9bffcb9 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-0d58c4f5-805d-4c62-9170-651d6620d44b req-e9e7243c-6101-42bc-9b9d-b3e0a9bffcb9 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] No waiting events found dispatching network-vif-unplugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.compute.manager [req-0d58c4f5-805d-4c62-9170-651d6620d44b req-e9e7243c-6101-42bc-9b9d-b3e0a9bffcb9 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-vif-unplugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.network.neutron [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updated VIF entry in instance network info cache for port 1f0c63c5-83d2-4858-aa77-1aabc9be4abd. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.network.neutron [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updating instance_info_cache with network_info: [{"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2b9f78bb-3f94-435d-8e6a-bdb54cf31540 req-e74daace-7191-482b-8f67-8342d51d7135 service nova] Releasing lock "refresh_cache-e3deb93d-2ad8-45fa-91f1-68d48dea5637" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:21:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Instance destroyed successfully.
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lazy-loading 'resources' on Instance uuid e3deb93d-2ad8-45fa-91f1-68d48dea5637 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-503206210',display_name='tempest-TestStampPattern-server-503206210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-503206210',id=36,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuU9vkRiUUY91H5G4dksku7YGxgAoLoORaB/v72MwRrgyh8Fg/Vdg35Djak3dez1Rc5MS6C6T9oWoKIMJP3KiX73yatqrHOUDzXbKpDFoqQWisLjqlFn8Tb0pNMuGOcTA==',key_name='tempest-TestStampPattern-1443624212',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef56c4a969bf4c7ea298d511ccda8490',ramdisk_id='',reservation_id='r-hmnr3yc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1856485652',owner_user_name='tempest-TestStampPattern-1856485652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:17:57Z,user_data=None,user_id='1b7e2843bba8470eb36bd37c721c7972',uuid=e3deb93d-2ad8-45fa-91f1-68d48dea5637,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converting VIF {"id": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "address": "fa:16:3e:90:62:79", "network": {"id": "8265ef9e-5077-4220-95ac-35feee73ab8c", "bridge": "br-int", "label": "tempest-TestStampPattern-1110816600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef56c4a969bf4c7ea298d511ccda8490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0c63c5-83", "ovs_interfaceid": "1f0c63c5-83d2-4858-aa77-1aabc9be4abd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG os_vif [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f0c63c5-83, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:21:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:21:55 user nova-compute[70594]: INFO os_vif [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:62:79,bridge_name='br-int',has_traffic_filtering=True,id=1f0c63c5-83d2-4858-aa77-1aabc9be4abd,network=Network(8265ef9e-5077-4220-95ac-35feee73ab8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0c63c5-83')
Jul 26 17:21:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Deleting instance files /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637_del
Jul 26 17:21:55 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Deletion of /opt/stack/data/nova/instances/e3deb93d-2ad8-45fa-91f1-68d48dea5637_del complete
Jul 26 17:21:56 user nova-compute[70594]: INFO nova.compute.manager [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 26 17:21:56 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:21:56 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Took 0.45 seconds to deallocate network for instance.
Jul 26 17:21:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:21:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:56 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Deleted allocations for instance e3deb93d-2ad8-45fa-91f1-68d48dea5637
Jul 26 17:21:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8b9b17a2-0bb6-4907-90f2-c51fcee3174a tempest-TestStampPattern-1856485652 tempest-TestStampPattern-1856485652-project-member] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] Acquiring lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:21:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:21:57 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] Lock "e3deb93d-2ad8-45fa-91f1-68d48dea5637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:21:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] No waiting events found dispatching network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:21:57 user nova-compute[70594]: WARNING nova.compute.manager [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received unexpected event network-vif-plugged-1f0c63c5-83d2-4858-aa77-1aabc9be4abd for instance with vm_state deleted and task_state None.
Jul 26 17:21:57 user nova-compute[70594]: DEBUG nova.compute.manager [req-31870cbf-1e70-4d3f-a0ef-ff0e9843995b req-17871a10-905b-45e0-9517-a48c5425d6e3 service nova] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Received event network-vif-deleted-1f0c63c5-83d2-4858-aa77-1aabc9be4abd {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:21:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:01 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392106.4397378, 70df069f-5f6c-4463-aa0d-4a323de18b10 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:22:01 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] VM Stopped (Lifecycle Event)
Jul 26 17:22:01 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392106.4503293, 08bc58e4-d6b2-493a-9d0f-ff43546997bc => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:22:01 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] VM Stopped (Lifecycle Event)
Jul 26 17:22:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d59b1762-a310-4a65-8f27-6b39a628cd54 None None] [instance: 70df069f-5f6c-4463-aa0d-4a323de18b10] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:22:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-de8595a4-f74c-4b4c-a770-66e442c4cde5 None None] [instance: 08bc58e4-d6b2-493a-9d0f-ff43546997bc] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:22:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:07 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:10 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392115.9585068, e3deb93d-2ad8-45fa-91f1-68d48dea5637 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:22:10 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] VM Stopped (Lifecycle Event)
Jul 26 17:22:10 user nova-compute[70594]: DEBUG nova.compute.manager [None req-b836b0d4-ba5b-4137-b4a7-57288e44cdaf None None] [instance: e3deb93d-2ad8-45fa-91f1-68d48dea5637] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:22:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:14 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:15 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:18 user nova-compute[70594]: INFO nova.compute.manager [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Terminating instance
Jul 26 17:22:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-dd4a8e49-8b83-456c-b87b-57eeb7a15df9 req-988386da-c429-4e77-b7e5-ab7dab1e1b68 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-unplugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dd4a8e49-8b83-456c-b87b-57eeb7a15df9 req-988386da-c429-4e77-b7e5-ab7dab1e1b68 service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dd4a8e49-8b83-456c-b87b-57eeb7a15df9 req-988386da-c429-4e77-b7e5-ab7dab1e1b68 service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dd4a8e49-8b83-456c-b87b-57eeb7a15df9 req-988386da-c429-4e77-b7e5-ab7dab1e1b68 service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-dd4a8e49-8b83-456c-b87b-57eeb7a15df9 req-988386da-c429-4e77-b7e5-ab7dab1e1b68 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-unplugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-dd4a8e49-8b83-456c-b87b-57eeb7a15df9 req-988386da-c429-4e77-b7e5-ab7dab1e1b68 service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-unplugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:18 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:22:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Instance destroyed successfully.
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.objects.instance [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'resources' on Instance uuid 356f54bb-c75c-4e17-8193-65f8a662e572 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1398093165',display_name='tempest-ServerActionsTestOtherA-server-1398093165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1398093165',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:17:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-f8ds1v5x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=356f54bb-c75c-4e17-8193-65f8a662e572,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "address": "fa:16:3e:3b:0e:67", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333cb45e-2a", "ovs_interfaceid": "333cb45e-2afd-421e-bfbb-99c24655ba0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_vif [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333cb45e-2a, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:22:19 user nova-compute[70594]: INFO os_vif [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:0e:67,bridge_name='br-int',has_traffic_filtering=True,id=333cb45e-2afd-421e-bfbb-99c24655ba0d,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333cb45e-2a')
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdhCZHLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:22:19 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b270b2f0-0a22-486d-b678-c497297b91ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:22:19 user nova-compute[70594]: No targets found.
Jul 26 17:22:19 user nova-compute[70594]: iSNS:
Jul 26 17:22:19 user nova-compute[70594]: No targets found.
Jul 26 17:22:19 user nova-compute[70594]: STATIC:
Jul 26 17:22:19 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022
Jul 26 17:22:19 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:22:19 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:22:19 user nova-compute[70594]: FIRMWARE:
Jul 26 17:22:19 user nova-compute[70594]: No targets found.
Jul 26 17:22:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:22:19 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:22:19 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce62694-46a2-4b71-a7bf-61c7a981a9f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa05ec67-7dfa-4bad-ad74-a7864527e1a1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:22:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 (non-flash)
Jul 26 17:22:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5910656830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32acfa11-685a-4bff-af87-271b67d8a218]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37824185-be2e-4083-992b-666d9543978b]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec6f2e-f5b7-4a93-9374-e59d0d9ed22d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[98efe31b-1951-42b3-8b73-970eb5af99d0]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17771ad-8b31-4674-9c15-8f7c1ca4fb53]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e8f11-4b20-4047-b0be-58d7ef3c11cd]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260]
Jul 26 17:22:19 user nova-compute[70594]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022, portal: 172.16.0.220,3260] successful.
Jul 26 17:22:19 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a93153-6f28-454c-ac48-813c06647022 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1658171-8984-4573-90b7-bddc9981f03c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] <== disconnect_volume: return (382ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:22:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Deleting instance files /opt/stack/data/nova/instances/356f54bb-c75c-4e17-8193-65f8a662e572_del
Jul 26 17:22:19 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Deletion of /opt/stack/data/nova/instances/356f54bb-c75c-4e17-8193-65f8a662e572_del complete
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: INFO nova.compute.manager [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:22:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.29690170288086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 6bd16164-caa5-442a-b55c-f84119c36256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 356f54bb-c75c-4e17-8193-65f8a662e572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d342176c-025e-416b-82a8-70fee04448eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-bd85beb1-7d6b-4d74-b3b0-bc0c018b3154 req-c3c4d369-e0e2-4af5-8266-441f8585407f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-deleted-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:20 user nova-compute[70594]: INFO nova.compute.manager [req-bd85beb1-7d6b-4d74-b3b0-bc0c018b3154 req-c3c4d369-e0e2-4af5-8266-441f8585407f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Neutron deleted interface 333cb45e-2afd-421e-bfbb-99c24655ba0d; detaching it from the instance and deleting it from the info cache
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.network.neutron [req-bd85beb1-7d6b-4d74-b3b0-bc0c018b3154 req-c3c4d369-e0e2-4af5-8266-441f8585407f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:22:20 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Took 1.00 seconds to deallocate network for instance.
Jul 26 17:22:20 user nova-compute[70594]: DEBUG nova.compute.manager [req-bd85beb1-7d6b-4d74-b3b0-bc0c018b3154 req-c3c4d369-e0e2-4af5-8266-441f8585407f service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Detach interface failed, port_id=333cb45e-2afd-421e-bfbb-99c24655ba0d, reason: Instance 356f54bb-c75c-4e17-8193-65f8a662e572 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-5374eed0-7da8-417a-bb92-2bf1e2f13b2e req-47a89384-1ffe-4559-a190-b47ee2002ead service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5374eed0-7da8-417a-bb92-2bf1e2f13b2e req-47a89384-1ffe-4559-a190-b47ee2002ead service nova] Acquiring lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5374eed0-7da8-417a-bb92-2bf1e2f13b2e req-47a89384-1ffe-4559-a190-b47ee2002ead service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5374eed0-7da8-417a-bb92-2bf1e2f13b2e req-47a89384-1ffe-4559-a190-b47ee2002ead service nova] Lock "356f54bb-c75c-4e17-8193-65f8a662e572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-5374eed0-7da8-417a-bb92-2bf1e2f13b2e req-47a89384-1ffe-4559-a190-b47ee2002ead service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] No waiting events found dispatching network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:22:21 user nova-compute[70594]: WARNING nova.compute.manager [req-5374eed0-7da8-417a-bb92-2bf1e2f13b2e req-47a89384-1ffe-4559-a190-b47ee2002ead service nova] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Received unexpected event network-vif-plugged-333cb45e-2afd-421e-bfbb-99c24655ba0d for instance with vm_state active and task_state deleting.
Jul 26 17:22:21 user nova-compute[70594]: INFO nova.compute.manager [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Took 0.75 seconds to detach 1 volumes for instance.
Jul 26 17:22:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Deleting volume: 79a93153-6f28-454c-ac48-813c06647022 {{(pid=70594) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:21 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Deleted allocations for instance 356f54bb-c75c-4e17-8193-65f8a662e572
Jul 26 17:22:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-091e0c53-51a4-444e-b70c-63d37fb78760 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "356f54bb-c75c-4e17-8193-65f8a662e572" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.404s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:22 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:22:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:22:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 17:22:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:34 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392139.133477, 356f54bb-c75c-4e17-8193-65f8a662e572 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:22:34 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] VM Stopped (Lifecycle Event)
Jul 26 17:22:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-c9b36edf-24c8-4ef6-be1a-57ede24daf3e None None] [instance: 356f54bb-c75c-4e17-8193-65f8a662e572] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:22:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "d342176c-025e-416b-82a8-70fee04448eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:45 user nova-compute[70594]: INFO nova.compute.manager [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Terminating instance
Jul 26 17:22:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5f06d76-11a8-49a2-bef5-b9ecaa66ae17 req-6ccb7f8a-025a-4173-89a2-e04a044c7de2 service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-unplugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5f06d76-11a8-49a2-bef5-b9ecaa66ae17 req-6ccb7f8a-025a-4173-89a2-e04a044c7de2 service nova] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5f06d76-11a8-49a2-bef5-b9ecaa66ae17 req-6ccb7f8a-025a-4173-89a2-e04a044c7de2 service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b5f06d76-11a8-49a2-bef5-b9ecaa66ae17 req-6ccb7f8a-025a-4173-89a2-e04a044c7de2 service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5f06d76-11a8-49a2-bef5-b9ecaa66ae17 req-6ccb7f8a-025a-4173-89a2-e04a044c7de2 service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] No waiting events found dispatching network-vif-unplugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-b5f06d76-11a8-49a2-bef5-b9ecaa66ae17 req-6ccb7f8a-025a-4173-89a2-e04a044c7de2 service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-unplugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] Instance destroyed successfully.
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.objects.instance [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lazy-loading 'resources' on Instance uuid d342176c-025e-416b-82a8-70fee04448eb {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1833416724',display_name='tempest-VolumesActionsTest-instance-1833416724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1833416724',id=45,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b13118c340f4eaabfbdc079710d7f4b',ramdisk_id='',reservation_id='r-csgoytf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-498904371',owner_user_name='tempest-VolumesActionsTest-498904371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:21:01Z,user_data=None,user_id='f8c2f0388cd44ee0a70d339848c959ce',uuid=d342176c-025e-416b-82a8-70fee04448eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converting VIF {"id": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "address": "fa:16:3e:17:dd:06", "network": {"id": "c8f4656a-8273-4fde-af9a-aff2202d6b29", "bridge": "br-int", "label": "tempest-VolumesActionsTest-526563233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b13118c340f4eaabfbdc079710d7f4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9789a7f3-c0", "ovs_interfaceid": "9789a7f3-c09d-4f7f-90f1-3f330e24f19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG os_vif [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9789a7f3-c0, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:22:46 user nova-compute[70594]: INFO os_vif [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:06,bridge_name='br-int',has_traffic_filtering=True,id=9789a7f3-c09d-4f7f-90f1-3f330e24f19c,network=Network(c8f4656a-8273-4fde-af9a-aff2202d6b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9789a7f3-c0')
Jul 26 17:22:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Deleting instance files /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb_del
Jul 26 17:22:46 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Deletion of /opt/stack/data/nova/instances/d342176c-025e-416b-82a8-70fee04448eb_del complete
Jul 26 17:22:46 user nova-compute[70594]: INFO nova.compute.manager [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] [instance: d342176c-025e-416b-82a8-70fee04448eb] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 26 17:22:46 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:22:46 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:22:47 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] Took 1.07 seconds to deallocate network for instance.
Jul 26 17:22:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:22:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:47 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Deleted allocations for instance d342176c-025e-416b-82a8-70fee04448eb
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-58e03d5e-f1bd-47b7-a409-5110f8e7950a tempest-VolumesActionsTest-498904371 tempest-VolumesActionsTest-498904371-project-member] Lock "d342176c-025e-416b-82a8-70fee04448eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] No waiting events found dispatching network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:22:48 user nova-compute[70594]: WARNING nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received unexpected event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c for instance with vm_state deleted and task_state None.
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] No waiting events found dispatching network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:22:48 user nova-compute[70594]: WARNING nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received unexpected event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c for instance with vm_state deleted and task_state None.
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Acquiring lock "d342176c-025e-416b-82a8-70fee04448eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] Lock "d342176c-025e-416b-82a8-70fee04448eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] No waiting events found dispatching network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:22:48 user nova-compute[70594]: WARNING nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received unexpected event network-vif-plugged-9789a7f3-c09d-4f7f-90f1-3f330e24f19c for instance with vm_state deleted and task_state None.
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [req-b9b2611e-2cf1-4d62-837f-935a8760daae req-3fd4760a-b0f4-4eeb-a8a0-a50f200a06ba service nova] [instance: d342176c-025e-416b-82a8-70fee04448eb] Received event network-vif-deleted-9789a7f3-c09d-4f7f-90f1-3f330e24f19c {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:22:48 user nova-compute[70594]: INFO nova.compute.claims [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Claim successful on node user
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:22:48 user nova-compute[70594]: DEBUG nova.network.neutron [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:22:48 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:22:49 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG nova.policy [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd221b17924ce3b9770c36fbbb52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f39be2f463416faaeae34d088bb57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:22:49 user nova-compute[70594]: INFO nova.virt.block_device [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Booting with volume bdf6fff1-8602-40ee-9cc1-ffe4f9591673 at /dev/vda
Jul 26 17:22:49 user nova-compute[70594]: DEBUG os_brick.utils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b308b123-d418-4e64-895f-33ed92a952fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cb125-9bd5-4be5-89f0-19f879983d6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f9ef8-4105-4efb-bff5-da161f828d42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37041ef7-f2df-4a4a-89bc-7c1291f81740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:22:49 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:22:49 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1e141d-6688-4053-b90a-f3ffad9da271]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG os_brick.utils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating existing volume attachment record: c26702d3-a679-4690-b2e5-3d39b881e47d {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:22:49 user nova-compute[70594]: DEBUG nova.network.neutron [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Successfully created port: 0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Successfully updated port: 0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquired lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-changed-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.compute.manager [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Refreshing instance network info cache due to event network-changed-0ca76dcc-dbbe-4adb-91e8-3652407deaf1. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] Acquiring lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.network.neutron [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating instance_info_cache with network_info: [{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Releasing lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Instance network_info: |[{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] Acquired lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:22:50 user nova-compute[70594]: DEBUG nova.network.neutron [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Refreshing network info cache for port 0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:22:51 user nova-compute[70594]: DEBUG nova.network.neutron [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updated VIF entry in instance network info cache for port 0ca76dcc-dbbe-4adb-91e8-3652407deaf1. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:22:51 user nova-compute[70594]: DEBUG nova.network.neutron [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating instance_info_cache with network_info: [{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:22:51 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-963e92de-76b1-4c30-98cc-150890543d8d req-d007f596-a655-43cc-8946-415c450cc1b5 service nova] Releasing lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:22:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:22:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:23:00 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Creating image(s)
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Ensure instance console log exists: /opt/stack/data/nova/instances/d3bae415-dd45-4872-ab8a-5b9768c75248/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Start _get_guest_xml network_info=[{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3bae415-dd45-4872-ab8a-5b9768c75248', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'serial': 'bdf6fff1-8602-40ee-9cc1-ffe4f9591673'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'c26702d3-a679-4690-b2e5-3d39b881e47d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:23:00 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:23:00 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:23:00 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:23:00 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:23:00 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2740d-413f-4054-8727-65995f8a78c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:23:00 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec8f084-d040-4827-b6da-9c5ed8fb7773]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673] added
Jul 26 17:23:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[145cf624-8912-426a-a91b-32793b94b4d7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d169eef-5b6a-4a8b-9988-d3a08d521f6c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaAsoOUY {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaAsoOUY" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19cad87-023f-4923-9687-b5633fed418b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eaAsoOUY'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c0bfb-f715-47fd-a795-50e33ef7baaf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a7d922-d8b9-49e4-9a64-ecb080018f7d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 26 17:23:00 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 26 17:23:00 user nova-compute[70594]:  {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:23:00 user nova-compute[70594]: WARNING os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 26 17:23:00 user nova-compute[70594]: 
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0813e4a-10ef-4e0c-936f-441d4372fe5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]
Jul 26 17:23:00 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.
Jul 26 17:23:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.157s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0c38c1-f4cc-4079-ad75-dfff55675a16]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3028963-ec8f-4233-b7d6-9c1c057d79eb]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:23:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:23:00 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbef6c3-da40-4a81-8972-962175edb151]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:23:00 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392166.4748316, d342176c-025e-416b-82a8-70fee04448eb => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:23:01 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: d342176c-025e-416b-82a8-70fee04448eb] VM Stopped (Lifecycle Event)
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.compute.manager [None req-d13d6e71-c2f4-4565-a405-25d34fff7b23 None None] [instance: d342176c-025e-416b-82a8-70fee04448eb] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26436303863626162', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436303863626162', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1064922809',display_name='tempest-TestVolumeBootPattern-server-1064922809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1064922809',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-lyx4af4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:22:49Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=d3bae415-dd45-4872-ab8a-5b9768c75248,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.objects.instance [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'pci_devices' on Instance uuid d3bae415-dd45-4872-ab8a-5b9768c75248 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:23:01 user nova-compute[70594]:   <uuid>d3bae415-dd45-4872-ab8a-5b9768c75248</uuid>
Jul 26 17:23:01 user nova-compute[70594]:   <name>instance-0000002e</name>
Jul 26 17:23:01 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:23:01 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:23:01 user nova-compute[70594]:   <metadata>
Jul 26 17:23:01 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:23:01 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:23:01 user nova-compute[70594]:       <nova:name>tempest-TestVolumeBootPattern-server-1064922809</nova:name>
Jul 26 17:23:01 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:23:00</nova:creationTime>
Jul 26 17:23:01 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:23:01 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:23:01 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:23:01 user nova-compute[70594]:       <nova:owner>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:user uuid="68fd221b17924ce3b9770c36fbbb52df">tempest-TestVolumeBootPattern-491432484-project-member</nova:user>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:project uuid="05f39be2f463416faaeae34d088bb57c">tempest-TestVolumeBootPattern-491432484</nova:project>
Jul 26 17:23:01 user nova-compute[70594]:       </nova:owner>
Jul 26 17:23:01 user nova-compute[70594]:       <nova:ports>
Jul 26 17:23:01 user nova-compute[70594]:         <nova:port uuid="0ca76dcc-dbbe-4adb-91e8-3652407deaf1">
Jul 26 17:23:01 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 26 17:23:01 user nova-compute[70594]:         </nova:port>
Jul 26 17:23:01 user nova-compute[70594]:       </nova:ports>
Jul 26 17:23:01 user nova-compute[70594]:     </nova:instance>
Jul 26 17:23:01 user nova-compute[70594]:   </metadata>
Jul 26 17:23:01 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:23:01 user nova-compute[70594]:     <system>
Jul 26 17:23:01 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:23:01 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:23:01 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:23:01 user nova-compute[70594]:       <entry name="serial">d3bae415-dd45-4872-ab8a-5b9768c75248</entry>
Jul 26 17:23:01 user nova-compute[70594]:       <entry name="uuid">d3bae415-dd45-4872-ab8a-5b9768c75248</entry>
Jul 26 17:23:01 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:23:01 user nova-compute[70594]:     </system>
Jul 26 17:23:01 user nova-compute[70594]:   </sysinfo>
Jul 26 17:23:01 user nova-compute[70594]:   <os>
Jul 26 17:23:01 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:23:01 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:23:01 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:23:01 user nova-compute[70594]:   </os>
Jul 26 17:23:01 user nova-compute[70594]:   <features>
Jul 26 17:23:01 user nova-compute[70594]:     <acpi/>
Jul 26 17:23:01 user nova-compute[70594]:     <apic/>
Jul 26 17:23:01 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:23:01 user nova-compute[70594]:   </features>
Jul 26 17:23:01 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:23:01 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:23:01 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:23:01 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:23:01 user nova-compute[70594]:   </clock>
Jul 26 17:23:01 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:23:01 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:23:01 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:23:01 user nova-compute[70594]:   </cpu>
Jul 26 17:23:01 user nova-compute[70594]:   <devices>
Jul 26 17:23:01 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:23:01 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:23:01 user nova-compute[70594]:       <source dev="/dev/sdb"/>
Jul 26 17:23:01 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:23:01 user nova-compute[70594]:       <serial>bdf6fff1-8602-40ee-9cc1-ffe4f9591673</serial>
Jul 26 17:23:01 user nova-compute[70594]:     </disk>
Jul 26 17:23:01 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:23:01 user nova-compute[70594]:       <mac address="fa:16:3e:36:9a:15"/>
Jul 26 17:23:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:23:01 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:23:01 user nova-compute[70594]:       <target dev="tap0ca76dcc-db"/>
Jul 26 17:23:01 user nova-compute[70594]:     </interface>
Jul 26 17:23:01 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:23:01 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/d3bae415-dd45-4872-ab8a-5b9768c75248/console.log" append="off"/>
Jul 26 17:23:01 user nova-compute[70594]:     </serial>
Jul 26 17:23:01 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:23:01 user nova-compute[70594]:     <video>
Jul 26 17:23:01 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:23:01 user nova-compute[70594]:     </video>
Jul 26 17:23:01 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:23:01 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:23:01 user nova-compute[70594]:     </rng>
Jul 26 17:23:01 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:23:01 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:23:01 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:23:01 user nova-compute[70594]:     </memballoon>
Jul 26 17:23:01 user nova-compute[70594]:   </devices>
Jul 26 17:23:01 user nova-compute[70594]: </domain>
Jul 26 17:23:01 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1064922809',display_name='tempest-TestVolumeBootPattern-server-1064922809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1064922809',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-lyx4af4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:22:49Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=d3bae415-dd45-4872-ab8a-5b9768c75248,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG os_vif [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca76dcc-db, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ca76dcc-db, col_values=(('external_ids', {'iface-id': '0ca76dcc-dbbe-4adb-91e8-3652407deaf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9a:15', 'vm-uuid': 'd3bae415-dd45-4872-ab8a-5b9768c75248'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:01 user nova-compute[70594]: INFO os_vif [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db')
Jul 26 17:23:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:23:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No VIF found with MAC fa:16:3e:36:9a:15, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-92196327-02a9-42ec-a9b8-438120565a52 req-c0f34517-e093-4d17-9a11-9d5f01e50ac1 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-92196327-02a9-42ec-a9b8-438120565a52 req-c0f34517-e093-4d17-9a11-9d5f01e50ac1 service nova] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-92196327-02a9-42ec-a9b8-438120565a52 req-c0f34517-e093-4d17-9a11-9d5f01e50ac1 service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-92196327-02a9-42ec-a9b8-438120565a52 req-c0f34517-e093-4d17-9a11-9d5f01e50ac1 service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-92196327-02a9-42ec-a9b8-438120565a52 req-c0f34517-e093-4d17-9a11-9d5f01e50ac1 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] No waiting events found dispatching network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:23:03 user nova-compute[70594]: WARNING nova.compute.manager [req-92196327-02a9-42ec-a9b8-438120565a52 req-c0f34517-e093-4d17-9a11-9d5f01e50ac1 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received unexpected event network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 for instance with vm_state building and task_state spawning.
Jul 26 17:23:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-ed6eeaca-efea-40d2-a6b9-d5981bb2d230 req-81c80496-798b-4882-a8f0-6c176ea30934 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed6eeaca-efea-40d2-a6b9-d5981bb2d230 req-81c80496-798b-4882-a8f0-6c176ea30934 service nova] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed6eeaca-efea-40d2-a6b9-d5981bb2d230 req-81c80496-798b-4882-a8f0-6c176ea30934 service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ed6eeaca-efea-40d2-a6b9-d5981bb2d230 req-81c80496-798b-4882-a8f0-6c176ea30934 service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [req-ed6eeaca-efea-40d2-a6b9-d5981bb2d230 req-81c80496-798b-4882-a8f0-6c176ea30934 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] No waiting events found dispatching network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:23:05 user nova-compute[70594]: WARNING nova.compute.manager [req-ed6eeaca-efea-40d2-a6b9-d5981bb2d230 req-81c80496-798b-4882-a8f0-6c176ea30934 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received unexpected event network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 for instance with vm_state building and task_state spawning.
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392185.7717452, d3bae415-dd45-4872-ab8a-5b9768c75248 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:23:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] VM Resumed (Lifecycle Event)
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:23:05 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Instance spawned successfully.
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:23:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392185.7729135, d3bae415-dd45-4872-ab8a-5b9768c75248 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:23:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] VM Started (Lifecycle Event)
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:23:05 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:23:05 user nova-compute[70594]: INFO nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Took 5.84 seconds to spawn the instance on the hypervisor.
Jul 26 17:23:05 user nova-compute[70594]: DEBUG nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:23:06 user nova-compute[70594]: INFO nova.compute.manager [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Took 17.48 seconds to build instance.
Jul 26 17:23:06 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-79b46ce4-5498-4019-bdab-2eafb576c292 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.572s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:15 user nova-compute[70594]: INFO nova.compute.manager [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Terminating instance
Jul 26 17:23:15 user nova-compute[70594]: DEBUG nova.compute.manager [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:23:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-8dddee2d-e90c-4c19-9caa-b05728c7911c req-693e0810-0de7-4b07-8938-111955c5bda8 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-unplugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8dddee2d-e90c-4c19-9caa-b05728c7911c req-693e0810-0de7-4b07-8938-111955c5bda8 service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8dddee2d-e90c-4c19-9caa-b05728c7911c req-693e0810-0de7-4b07-8938-111955c5bda8 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8dddee2d-e90c-4c19-9caa-b05728c7911c req-693e0810-0de7-4b07-8938-111955c5bda8 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-8dddee2d-e90c-4c19-9caa-b05728c7911c req-693e0810-0de7-4b07-8938-111955c5bda8 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-unplugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-8dddee2d-e90c-4c19-9caa-b05728c7911c req-693e0810-0de7-4b07-8938-111955c5bda8 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-unplugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Instance destroyed successfully.
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.objects.instance [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lazy-loading 'resources' on Instance uuid 6bd16164-caa5-442a-b55c-f84119c36256 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-26T17:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-183510375',display_name='tempest-ServerActionsTestOtherA-server-1410367531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-183510375',id=27,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRLkHp0jcw0m3jcUaGs98qtEdUFSG7H+KV+ykZ+Ivx0VJN4kS6gHfUukkbJsvWSje/N4z3hTEP1f883zm88cODEacaEF8CHIVNrb9mms13VxvYrXcret8BRF/5161gw3w==',key_name='tempest-keypair-1051423629',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:11:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4cf13ef41474309a9651baab74f6903',ramdisk_id='',reservation_id='r-okf8hylx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1622849011',owner_user_name='tempest-ServerActionsTestOtherA-1622849011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feffa97fa65d4c2e963c6ef550377550',uuid=6bd16164-caa5-442a-b55c-f84119c36256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converting VIF {"id": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "address": "fa:16:3e:5e:43:0c", "network": {"id": "cd5b8b52-9307-4c92-9b18-be96da762631", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-46833361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4cf13ef41474309a9651baab74f6903", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd093a50-c1", "ovs_interfaceid": "fd093a50-c11a-4ba5-b451-63176c04f7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG os_vif [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd093a50-c1, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:23:16 user nova-compute[70594]: INFO os_vif [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:43:0c,bridge_name='br-int',has_traffic_filtering=True,id=fd093a50-c11a-4ba5-b451-63176c04f7a8,network=Network(cd5b8b52-9307-4c92-9b18-be96da762631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd093a50-c1')
Jul 26 17:23:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Deleting instance files /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256_del
Jul 26 17:23:16 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Deletion of /opt/stack/data/nova/instances/6bd16164-caa5-442a-b55c-f84119c36256_del complete
Jul 26 17:23:16 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:16 user nova-compute[70594]: INFO nova.compute.manager [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 26 17:23:16 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:23:16 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:23:17 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Took 0.54 seconds to deallocate network for instance.
Jul 26 17:23:17 user nova-compute[70594]: DEBUG nova.compute.manager [req-4bd1ad5b-e1ef-4352-90f8-ad110dc1c5ad req-d060b750-a9eb-4283-a128-b42e6f220a24 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-deleted-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:17 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Deleted allocations for instance 6bd16164-caa5-442a-b55c-f84119c36256
Jul 26 17:23:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-bb67b44c-6f36-41cf-9ccc-24b3d6065f96 tempest-ServerActionsTestOtherA-1622849011 tempest-ServerActionsTestOtherA-1622849011-project-member] Lock "6bd16164-caa5-442a-b55c-f84119c36256" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:17 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-09432e58-14f4-4883-9da9-af98942fac60 req-02649860-0ce9-4b18-b089-65d598a4c7e7 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-09432e58-14f4-4883-9da9-af98942fac60 req-02649860-0ce9-4b18-b089-65d598a4c7e7 service nova] Acquiring lock "6bd16164-caa5-442a-b55c-f84119c36256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-09432e58-14f4-4883-9da9-af98942fac60 req-02649860-0ce9-4b18-b089-65d598a4c7e7 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-09432e58-14f4-4883-9da9-af98942fac60 req-02649860-0ce9-4b18-b089-65d598a4c7e7 service nova] Lock "6bd16164-caa5-442a-b55c-f84119c36256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-09432e58-14f4-4883-9da9-af98942fac60 req-02649860-0ce9-4b18-b089-65d598a4c7e7 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] No waiting events found dispatching network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:23:18 user nova-compute[70594]: WARNING nova.compute.manager [req-09432e58-14f4-4883-9da9-af98942fac60 req-02649860-0ce9-4b18-b089-65d598a4c7e7 service nova] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Received unexpected event network-vif-plugged-fd093a50-c11a-4ba5-b451-63176c04f7a8 for instance with vm_state deleted and task_state None.
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:23:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:23:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:23:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.337047576904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d3bae415-dd45-4872-ab8a-5b9768c75248 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:23:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:23:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:23:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid d3bae415-dd45-4872-ab8a-5b9768c75248 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating instance_info_cache with network_info: [{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:23:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:23:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:31 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392196.7027738, 6bd16164-caa5-442a-b55c-f84119c36256 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:23:31 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] VM Stopped (Lifecycle Event)
Jul 26 17:23:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9358c464-e313-48db-ac00-2d934d9627f4 None None] [instance: 6bd16164-caa5-442a-b55c-f84119c36256] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:23:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:23:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:23:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:23:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:23:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:24:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:15 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:17 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:24:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:24:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:24:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=25.32443618774414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance d3bae415-dd45-4872-ab8a-5b9768c75248 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:24:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:24:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:24:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid d3bae415-dd45-4872-ab8a-5b9768c75248 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:24:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating instance_info_cache with network_info: [{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:24:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:24:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:24:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 17:24:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 17:24:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:30 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:24:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:30 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:24:30 user nova-compute[70594]: INFO nova.compute.claims [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Claim successful on node user
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.network.neutron [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:24:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.policy [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceac1fcf58744384b3960b8c736ece77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3473a9917a4c8db792409b139e8262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:24:31 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Creating image(s)
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "/opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "/opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "/opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.183s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.143s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk 1073741824" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.202s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Cannot resize image /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG nova.objects.instance [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'migration_context' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Ensure instance console log exists: /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:32 user nova-compute[70594]: DEBUG nova.network.neutron [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Successfully created port: 1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG nova.network.neutron [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Successfully updated port: 1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquired lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG nova.network.neutron [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG nova.network.neutron [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-changed-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG nova.compute.manager [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Refreshing instance network info cache due to event network-changed-1c4eeb25-2562-4b7a-a768-3abf00ff6afc. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:24:33 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] Acquiring lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.neutron [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating instance_info_cache with network_info: [{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Releasing lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Instance network_info: |[{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] Acquired lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Refreshing network info cache for port 1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Start _get_guest_xml network_info=[{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:24:34 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:24:34 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1802184836',display_name='tempest-VolumesSnapshotTestJSON-instance-1802184836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1802184836',id=47,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJgM7KHbV7ilzkAWIFcpNFvOLYRGSVmdCuI/hEPpvpQnT6e08z1azrg0jpKBQgJ25bPXVvgd+wA9F0b/yfnIgVHr7TX7C+D8J9BxzOnUYx97BRSKyjJRC4DWtiUBT7MLw==',key_name='tempest-keypair-1580717129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee3473a9917a4c8db792409b139e8262',ramdisk_id='',reservation_id='r-r7vamuvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-953872237',owner_user_name='tempest-VolumesSnapshotTestJSON-953872237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceac1fcf58744384b3960b8c736ece77',uuid=04f36f3f-8776-4d39-82fc-f464913f846f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converting VIF {"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.objects.instance [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'pci_devices' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:24:34 user nova-compute[70594]:   <uuid>04f36f3f-8776-4d39-82fc-f464913f846f</uuid>
Jul 26 17:24:34 user nova-compute[70594]:   <name>instance-0000002f</name>
Jul 26 17:24:34 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:24:34 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:24:34 user nova-compute[70594]:   <metadata>
Jul 26 17:24:34 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:24:34 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:24:34 user nova-compute[70594]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1802184836</nova:name>
Jul 26 17:24:34 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:24:34</nova:creationTime>
Jul 26 17:24:34 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:24:34 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:24:34 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:24:34 user nova-compute[70594]:       <nova:owner>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:user uuid="ceac1fcf58744384b3960b8c736ece77">tempest-VolumesSnapshotTestJSON-953872237-project-member</nova:user>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:project uuid="ee3473a9917a4c8db792409b139e8262">tempest-VolumesSnapshotTestJSON-953872237</nova:project>
Jul 26 17:24:34 user nova-compute[70594]:       </nova:owner>
Jul 26 17:24:34 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:24:34 user nova-compute[70594]:       <nova:ports>
Jul 26 17:24:34 user nova-compute[70594]:         <nova:port uuid="1c4eeb25-2562-4b7a-a768-3abf00ff6afc">
Jul 26 17:24:34 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 26 17:24:34 user nova-compute[70594]:         </nova:port>
Jul 26 17:24:34 user nova-compute[70594]:       </nova:ports>
Jul 26 17:24:34 user nova-compute[70594]:     </nova:instance>
Jul 26 17:24:34 user nova-compute[70594]:   </metadata>
Jul 26 17:24:34 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:24:34 user nova-compute[70594]:     <system>
Jul 26 17:24:34 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:24:34 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:24:34 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:24:34 user nova-compute[70594]:       <entry name="serial">04f36f3f-8776-4d39-82fc-f464913f846f</entry>
Jul 26 17:24:34 user nova-compute[70594]:       <entry name="uuid">04f36f3f-8776-4d39-82fc-f464913f846f</entry>
Jul 26 17:24:34 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:24:34 user nova-compute[70594]:     </system>
Jul 26 17:24:34 user nova-compute[70594]:   </sysinfo>
Jul 26 17:24:34 user nova-compute[70594]:   <os>
Jul 26 17:24:34 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:24:34 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:24:34 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:24:34 user nova-compute[70594]:   </os>
Jul 26 17:24:34 user nova-compute[70594]:   <features>
Jul 26 17:24:34 user nova-compute[70594]:     <acpi/>
Jul 26 17:24:34 user nova-compute[70594]:     <apic/>
Jul 26 17:24:34 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:24:34 user nova-compute[70594]:   </features>
Jul 26 17:24:34 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:24:34 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:24:34 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:24:34 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:24:34 user nova-compute[70594]:   </clock>
Jul 26 17:24:34 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:24:34 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:24:34 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:24:34 user nova-compute[70594]:   </cpu>
Jul 26 17:24:34 user nova-compute[70594]:   <devices>
Jul 26 17:24:34 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:24:34 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:24:34 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk"/>
Jul 26 17:24:34 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:24:34 user nova-compute[70594]:     </disk>
Jul 26 17:24:34 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:24:34 user nova-compute[70594]:       <mac address="fa:16:3e:e8:56:1e"/>
Jul 26 17:24:34 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:24:34 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:24:34 user nova-compute[70594]:       <target dev="tap1c4eeb25-25"/>
Jul 26 17:24:34 user nova-compute[70594]:     </interface>
Jul 26 17:24:34 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:24:34 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/console.log" append="off"/>
Jul 26 17:24:34 user nova-compute[70594]:     </serial>
Jul 26 17:24:34 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:24:34 user nova-compute[70594]:     <video>
Jul 26 17:24:34 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:24:34 user nova-compute[70594]:     </video>
Jul 26 17:24:34 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:24:34 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:24:34 user nova-compute[70594]:     </rng>
Jul 26 17:24:34 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:24:34 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:24:34 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:24:34 user nova-compute[70594]:     </memballoon>
Jul 26 17:24:34 user nova-compute[70594]:   </devices>
Jul 26 17:24:34 user nova-compute[70594]: </domain>
Jul 26 17:24:34 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1802184836',display_name='tempest-VolumesSnapshotTestJSON-instance-1802184836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1802184836',id=47,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJgM7KHbV7ilzkAWIFcpNFvOLYRGSVmdCuI/hEPpvpQnT6e08z1azrg0jpKBQgJ25bPXVvgd+wA9F0b/yfnIgVHr7TX7C+D8J9BxzOnUYx97BRSKyjJRC4DWtiUBT7MLw==',key_name='tempest-keypair-1580717129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee3473a9917a4c8db792409b139e8262',ramdisk_id='',reservation_id='r-r7vamuvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-953872237',owner_user_name='tempest-VolumesSnapshotTestJSON-953872237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceac1fcf58744384b3960b8c736ece77',uuid=04f36f3f-8776-4d39-82fc-f464913f846f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converting VIF {"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG os_vif [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c4eeb25-25, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c4eeb25-25, col_values=(('external_ids', {'iface-id': '1c4eeb25-2562-4b7a-a768-3abf00ff6afc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:56:1e', 'vm-uuid': '04f36f3f-8776-4d39-82fc-f464913f846f'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:34 user nova-compute[70594]: INFO os_vif [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25')
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No VIF found with MAC fa:16:3e:e8:56:1e, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updated VIF entry in instance network info cache for port 1c4eeb25-2562-4b7a-a768-3abf00ff6afc. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG nova.network.neutron [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating instance_info_cache with network_info: [{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:24:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-c6fbe29f-be77-420b-8fdd-63acfbde7b38 req-a19630f2-f686-466f-8105-59a9bb587224 service nova] Releasing lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-24b5b2d9-ad39-4ff1-9778-ef17cc06b848 req-53e58c33-9ccb-4adc-8588-c553bbe41507 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-24b5b2d9-ad39-4ff1-9778-ef17cc06b848 req-53e58c33-9ccb-4adc-8588-c553bbe41507 service nova] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-24b5b2d9-ad39-4ff1-9778-ef17cc06b848 req-53e58c33-9ccb-4adc-8588-c553bbe41507 service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-24b5b2d9-ad39-4ff1-9778-ef17cc06b848 req-53e58c33-9ccb-4adc-8588-c553bbe41507 service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:35 user nova-compute[70594]: DEBUG nova.compute.manager [req-24b5b2d9-ad39-4ff1-9778-ef17cc06b848 req-53e58c33-9ccb-4adc-8588-c553bbe41507 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] No waiting events found dispatching network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:24:35 user nova-compute[70594]: WARNING nova.compute.manager [req-24b5b2d9-ad39-4ff1-9778-ef17cc06b848 req-53e58c33-9ccb-4adc-8588-c553bbe41507 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received unexpected event network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc for instance with vm_state building and task_state spawning.
Jul 26 17:24:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:36 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392277.8096843, 04f36f3f-8776-4d39-82fc-f464913f846f => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:24:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] VM Resumed (Lifecycle Event)
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:24:37 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Instance spawned successfully.
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:24:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392277.815743, 04f36f3f-8776-4d39-82fc-f464913f846f => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:24:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] VM Started (Lifecycle Event)
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e393d355-cd9b-4188-a092-10f10d1e44e7 req-1d6a642c-d3d9-4a33-a9a2-1132c6663e5d service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e393d355-cd9b-4188-a092-10f10d1e44e7 req-1d6a642c-d3d9-4a33-a9a2-1132c6663e5d service nova] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e393d355-cd9b-4188-a092-10f10d1e44e7 req-1d6a642c-d3d9-4a33-a9a2-1132c6663e5d service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e393d355-cd9b-4188-a092-10f10d1e44e7 req-1d6a642c-d3d9-4a33-a9a2-1132c6663e5d service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e393d355-cd9b-4188-a092-10f10d1e44e7 req-1d6a642c-d3d9-4a33-a9a2-1132c6663e5d service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] No waiting events found dispatching network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:24:37 user nova-compute[70594]: WARNING nova.compute.manager [req-e393d355-cd9b-4188-a092-10f10d1e44e7 req-1d6a642c-d3d9-4a33-a9a2-1132c6663e5d service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received unexpected event network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc for instance with vm_state building and task_state spawning.
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:24:37 user nova-compute[70594]: INFO nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Took 6.44 seconds to spawn the instance on the hypervisor.
Jul 26 17:24:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:24:37 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:24:38 user nova-compute[70594]: INFO nova.compute.manager [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Took 7.17 seconds to build instance.
Jul 26 17:24:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-144aa86e-6a71-4c22-ae17-03d06bdc008d tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.285s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-changed-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Refreshing instance network info cache due to event network-changed-0ca76dcc-dbbe-4adb-91e8-3652407deaf1. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:24:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] Acquiring lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:24:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] Acquired lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:24:41 user nova-compute[70594]: DEBUG nova.network.neutron [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Refreshing network info cache for port 0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:24:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG nova.network.neutron [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updated VIF entry in instance network info cache for port 0ca76dcc-dbbe-4adb-91e8-3652407deaf1. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG nova.network.neutron [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating instance_info_cache with network_info: [{"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6209c59c-3a8d-4075-89dd-a2f947c9731e req-cdfa6992-5bf4-431d-b6fb-7a3efd142f5a service nova] Releasing lock "refresh_cache-d3bae415-dd45-4872-ab8a-5b9768c75248" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:42 user nova-compute[70594]: INFO nova.compute.manager [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Terminating instance
Jul 26 17:24:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-2092555b-c650-44e4-96b1-f8a830422f26 req-9ac02633-f202-455a-aa67-2b5216d0a13d service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-vif-unplugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2092555b-c650-44e4-96b1-f8a830422f26 req-9ac02633-f202-455a-aa67-2b5216d0a13d service nova] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2092555b-c650-44e4-96b1-f8a830422f26 req-9ac02633-f202-455a-aa67-2b5216d0a13d service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2092555b-c650-44e4-96b1-f8a830422f26 req-9ac02633-f202-455a-aa67-2b5216d0a13d service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-2092555b-c650-44e4-96b1-f8a830422f26 req-9ac02633-f202-455a-aa67-2b5216d0a13d service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] No waiting events found dispatching network-vif-unplugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:24:42 user nova-compute[70594]: DEBUG nova.compute.manager [req-2092555b-c650-44e4-96b1-f8a830422f26 req-9ac02633-f202-455a-aa67-2b5216d0a13d service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-vif-unplugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Instance destroyed successfully.
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'resources' on Instance uuid d3bae415-dd45-4872-ab8a-5b9768c75248 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1064922809',display_name='tempest-TestVolumeBootPattern-server-1064922809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1064922809',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:23:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-lyx4af4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:23:06Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=d3bae415-dd45-4872-ab8a-5b9768c75248,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "address": "fa:16:3e:36:9a:15", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca76dcc-db", "ovs_interfaceid": "0ca76dcc-dbbe-4adb-91e8-3652407deaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_vif [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca76dcc-db, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:24:43 user nova-compute[70594]: INFO os_vif [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9a:15,bridge_name='br-int',has_traffic_filtering=True,id=0ca76dcc-dbbe-4adb-91e8-3652407deaf1,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca76dcc-db')
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:24:43 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c03ab9-efdd-4a2d-b07f-f13878a609fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:24:43 user nova-compute[70594]: No targets found.
Jul 26 17:24:43 user nova-compute[70594]: iSNS:
Jul 26 17:24:43 user nova-compute[70594]: No targets found.
Jul 26 17:24:43 user nova-compute[70594]: STATIC:
Jul 26 17:24:43 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:24:43 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:24:43 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:24:43 user nova-compute[70594]: FIRMWARE:
Jul 26 17:24:43 user nova-compute[70594]: No targets found.
Jul 26 17:24:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:24:43 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:24:43 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6787c45e-8901-4c61-a095-a0a33f96722b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39997647-e12c-4949-a3e0-8f4829b33b0f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:24:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:24:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591830d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673'): ({'sdb'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Removing single pathed devices sdb {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b8b6a-f61f-4abe-a00e-2ed1c5892c2e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[50acf5c4-da0a-4dd1-9c87-7f1d5c487f87]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flushing IO for device /dev/sdb {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d695bbd0-6d09-497e-aeda-121b40925130]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c6a6ec-a8fb-449f-bf69-e9aacd54129c]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26436303863626162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f934f825', '/dev/disk/by-id/scsi-1SCST_BIOf934f825-d608cbab7e53b355') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d345cf71-e7a5-4760-bec9-135cc0de328e]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e1d55f-2cad-42c5-9fe2-5ca5cd9d0a64]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ff281-b7bc-4b4d-ba94-69d62ee78b02]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]
Jul 26 17:24:43 user nova-compute[70594]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.
Jul 26 17:24:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d8cf9-3a96-4216-b654-78bfe1541f64]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== disconnect_volume: return (342ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:24:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Deleting instance files /opt/stack/data/nova/instances/d3bae415-dd45-4872-ab8a-5b9768c75248_del
Jul 26 17:24:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Deletion of /opt/stack/data/nova/instances/d3bae415-dd45-4872-ab8a-5b9768c75248_del complete
Jul 26 17:24:43 user nova-compute[70594]: INFO nova.compute.manager [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 26 17:24:43 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:24:43 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:24:44 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:24:44 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Took 0.98 seconds to deallocate network for instance.
Jul 26 17:24:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-4f7eddef-d8c8-4e89-896d-53bff637479b req-b7f31dec-a4c5-46cf-904a-aa96000d09e4 service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-vif-deleted-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-ba014f26-c5de-422e-bbe1-072d25e192c4 req-01e590d6-0ada-4ecc-8718-1b8392e186ca service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received event network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:24:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ba014f26-c5de-422e-bbe1-072d25e192c4 req-01e590d6-0ada-4ecc-8718-1b8392e186ca service nova] Acquiring lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ba014f26-c5de-422e-bbe1-072d25e192c4 req-01e590d6-0ada-4ecc-8718-1b8392e186ca service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ba014f26-c5de-422e-bbe1-072d25e192c4 req-01e590d6-0ada-4ecc-8718-1b8392e186ca service nova] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-ba014f26-c5de-422e-bbe1-072d25e192c4 req-01e590d6-0ada-4ecc-8718-1b8392e186ca service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] No waiting events found dispatching network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:24:44 user nova-compute[70594]: WARNING nova.compute.manager [req-ba014f26-c5de-422e-bbe1-072d25e192c4 req-01e590d6-0ada-4ecc-8718-1b8392e186ca service nova] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Received unexpected event network-vif-plugged-0ca76dcc-dbbe-4adb-91e8-3652407deaf1 for instance with vm_state active and task_state deleting.
Jul 26 17:24:46 user nova-compute[70594]: INFO nova.compute.manager [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Took 1.50 seconds to detach 1 volumes for instance.
Jul 26 17:24:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:24:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:24:46 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:24:46 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:24:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:46 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Deleted allocations for instance d3bae415-dd45-4872-ab8a-5b9768c75248
Jul 26 17:24:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-a9326997-384b-46c3-a223-7242c3befd26 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "d3bae415-dd45-4872-ab8a-5b9768c75248" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.108s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:24:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:51 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:24:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:24:58 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392283.1800501, d3bae415-dd45-4872-ab8a-5b9768c75248 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:24:58 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] VM Stopped (Lifecycle Event)
Jul 26 17:24:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2bea51b5-6a30-4d87-b5cc-afda13e065b8 None None] [instance: d3bae415-dd45-4872-ab8a-5b9768c75248] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:24:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:07 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:07 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Triggering sync for uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 26 17:25:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:07 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:25:18 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:25:19 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:25:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.282978057861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 04f36f3f-8776-4d39-82fc-f464913f846f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:25:19 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:25:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:25:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:21 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:25:21 user nova-compute[70594]: INFO nova.compute.claims [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Claim successful on node user
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:25:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.policy [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6297345c1eda4576b56e7d0a05873fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6cb23095c24696867e34cec0b6f114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:25:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Creating image(s)
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "/opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "/opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "/opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.139s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk 1073741824" returned: 0 in 0.051s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:25:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Successfully created port: 1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Cannot resize image /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'migration_context' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Ensure instance console log exists: /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Successfully updated port: 1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-changed-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.compute.manager [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Refreshing instance network info cache due to event network-changed-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] Acquiring lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] Acquired lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Refreshing network info cache for port 1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8c9cd9f5-96d0-4a11-862b-2162a8490e1c req-8ca8ae63-b519-4322-9765-ddd8646c9e4a service nova] Releasing lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquired lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating instance_info_cache with network_info: [{"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Releasing lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Instance network_info: |[{"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Start _get_guest_xml network_info=[{"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:25:24 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:25:24 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Skipping network cache update for instance because it is Building. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1099594416',display_name='tempest-TestServerVolumeAttachmentScenario-server-1099594416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1099594416',id=48,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwiRHQ9fhjZ+tROMZtrxe+0WtGXBc9zNdm3uU2Ij8BXRWPgMSpyUZ2ubdwc6vtWZFmHFGLN2PrQ1pwkW+Upt7gODvAk7AvZlNpH5SwIDfdfY+vUYDMLdw0wR7KCWFTvWw==',key_name='tempest-keypair-1841940591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a6cb23095c24696867e34cec0b6f114',ramdisk_id='',reservation_id='r-l5iycnpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1663160358',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1663160358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6297345c1eda4576b56e7d0a05873fd5',uuid=77065735-9358-4489-905f-f83e1a8f9869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Converting VIF {"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'pci_devices' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:25:24 user nova-compute[70594]:   <uuid>77065735-9358-4489-905f-f83e1a8f9869</uuid>
Jul 26 17:25:24 user nova-compute[70594]:   <name>instance-00000030</name>
Jul 26 17:25:24 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:25:24 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:25:24 user nova-compute[70594]:   <metadata>
Jul 26 17:25:24 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:25:24 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:25:24 user nova-compute[70594]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1099594416</nova:name>
Jul 26 17:25:24 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:25:24</nova:creationTime>
Jul 26 17:25:24 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:25:24 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:25:24 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:25:24 user nova-compute[70594]:       <nova:owner>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:user uuid="6297345c1eda4576b56e7d0a05873fd5">tempest-TestServerVolumeAttachmentScenario-1663160358-project-member</nova:user>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:project uuid="0a6cb23095c24696867e34cec0b6f114">tempest-TestServerVolumeAttachmentScenario-1663160358</nova:project>
Jul 26 17:25:24 user nova-compute[70594]:       </nova:owner>
Jul 26 17:25:24 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:25:24 user nova-compute[70594]:       <nova:ports>
Jul 26 17:25:24 user nova-compute[70594]:         <nova:port uuid="1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2">
Jul 26 17:25:24 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:25:24 user nova-compute[70594]:         </nova:port>
Jul 26 17:25:24 user nova-compute[70594]:       </nova:ports>
Jul 26 17:25:24 user nova-compute[70594]:     </nova:instance>
Jul 26 17:25:24 user nova-compute[70594]:   </metadata>
Jul 26 17:25:24 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:25:24 user nova-compute[70594]:     <system>
Jul 26 17:25:24 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:25:24 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:25:24 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:25:24 user nova-compute[70594]:       <entry name="serial">77065735-9358-4489-905f-f83e1a8f9869</entry>
Jul 26 17:25:24 user nova-compute[70594]:       <entry name="uuid">77065735-9358-4489-905f-f83e1a8f9869</entry>
Jul 26 17:25:24 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:25:24 user nova-compute[70594]:     </system>
Jul 26 17:25:24 user nova-compute[70594]:   </sysinfo>
Jul 26 17:25:24 user nova-compute[70594]:   <os>
Jul 26 17:25:24 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:25:24 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:25:24 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:25:24 user nova-compute[70594]:   </os>
Jul 26 17:25:24 user nova-compute[70594]:   <features>
Jul 26 17:25:24 user nova-compute[70594]:     <acpi/>
Jul 26 17:25:24 user nova-compute[70594]:     <apic/>
Jul 26 17:25:24 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:25:24 user nova-compute[70594]:   </features>
Jul 26 17:25:24 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:25:24 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:25:24 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:25:24 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:25:24 user nova-compute[70594]:   </clock>
Jul 26 17:25:24 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:25:24 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:25:24 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:25:24 user nova-compute[70594]:   </cpu>
Jul 26 17:25:24 user nova-compute[70594]:   <devices>
Jul 26 17:25:24 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:25:24 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:25:24 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk"/>
Jul 26 17:25:24 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:25:24 user nova-compute[70594]:     </disk>
Jul 26 17:25:24 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:25:24 user nova-compute[70594]:       <mac address="fa:16:3e:af:27:b1"/>
Jul 26 17:25:24 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:25:24 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:25:24 user nova-compute[70594]:       <target dev="tap1cbeb7a3-1a"/>
Jul 26 17:25:24 user nova-compute[70594]:     </interface>
Jul 26 17:25:24 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:25:24 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/console.log" append="off"/>
Jul 26 17:25:24 user nova-compute[70594]:     </serial>
Jul 26 17:25:24 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:25:24 user nova-compute[70594]:     <video>
Jul 26 17:25:24 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:25:24 user nova-compute[70594]:     </video>
Jul 26 17:25:24 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:25:24 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:25:24 user nova-compute[70594]:     </rng>
Jul 26 17:25:24 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:25:24 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:25:24 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:25:24 user nova-compute[70594]:     </memballoon>
Jul 26 17:25:24 user nova-compute[70594]:   </devices>
Jul 26 17:25:24 user nova-compute[70594]: </domain>
Jul 26 17:25:24 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1099594416',display_name='tempest-TestServerVolumeAttachmentScenario-server-1099594416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1099594416',id=48,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwiRHQ9fhjZ+tROMZtrxe+0WtGXBc9zNdm3uU2Ij8BXRWPgMSpyUZ2ubdwc6vtWZFmHFGLN2PrQ1pwkW+Upt7gODvAk7AvZlNpH5SwIDfdfY+vUYDMLdw0wR7KCWFTvWw==',key_name='tempest-keypair-1841940591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a6cb23095c24696867e34cec0b6f114',ramdisk_id='',reservation_id='r-l5iycnpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1663160358',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1663160358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6297345c1eda4576b56e7d0a05873fd5',uuid=77065735-9358-4489-905f-f83e1a8f9869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Converting VIF {"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG os_vif [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cbeb7a3-1a, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cbeb7a3-1a, col_values=(('external_ids', {'iface-id': '1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:27:b1', 'vm-uuid': '77065735-9358-4489-905f-f83e1a8f9869'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:25:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:24 user nova-compute[70594]: INFO os_vif [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a')
Jul 26 17:25:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:25:25 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No VIF found with MAC fa:16:3e:af:27:b1, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:25:25 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating instance_info_cache with network_info: [{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:25:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:25:25 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:25:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-562c8d4d-66df-462b-b849-f9703831c0d1 req-0fdbb8d3-f2f8-4061-9d34-54f5c72ab12d service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-562c8d4d-66df-462b-b849-f9703831c0d1 req-0fdbb8d3-f2f8-4061-9d34-54f5c72ab12d service nova] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-562c8d4d-66df-462b-b849-f9703831c0d1 req-0fdbb8d3-f2f8-4061-9d34-54f5c72ab12d service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-562c8d4d-66df-462b-b849-f9703831c0d1 req-0fdbb8d3-f2f8-4061-9d34-54f5c72ab12d service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-562c8d4d-66df-462b-b849-f9703831c0d1 req-0fdbb8d3-f2f8-4061-9d34-54f5c72ab12d service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] No waiting events found dispatching network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:25:26 user nova-compute[70594]: WARNING nova.compute.manager [req-562c8d4d-66df-462b-b849-f9703831c0d1 req-0fdbb8d3-f2f8-4061-9d34-54f5c72ab12d service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received unexpected event network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 for instance with vm_state building and task_state spawning.
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392328.4102254, 77065735-9358-4489-905f-f83e1a8f9869 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] VM Resumed (Lifecycle Event)
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Instance spawned successfully.
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392328.4140403, 77065735-9358-4489-905f-f83e1a8f9869 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] VM Started (Lifecycle Event)
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Took 6.12 seconds to spawn the instance on the hypervisor.
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:25:28 user nova-compute[70594]: INFO nova.compute.manager [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Took 6.66 seconds to build instance.
Jul 26 17:25:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-f6892555-0197-4604-9dc1-7f724aef62cf tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.803s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [req-205180d9-c20d-41bd-8586-f34dafd68f9e req-5bd700d2-cc79-49b8-bacf-84eac6b8600e service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-205180d9-c20d-41bd-8586-f34dafd68f9e req-5bd700d2-cc79-49b8-bacf-84eac6b8600e service nova] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-205180d9-c20d-41bd-8586-f34dafd68f9e req-5bd700d2-cc79-49b8-bacf-84eac6b8600e service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-205180d9-c20d-41bd-8586-f34dafd68f9e req-5bd700d2-cc79-49b8-bacf-84eac6b8600e service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:28 user nova-compute[70594]: DEBUG nova.compute.manager [req-205180d9-c20d-41bd-8586-f34dafd68f9e req-5bd700d2-cc79-49b8-bacf-84eac6b8600e service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] No waiting events found dispatching network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:25:28 user nova-compute[70594]: WARNING nova.compute.manager [req-205180d9-c20d-41bd-8586-f34dafd68f9e req-5bd700d2-cc79-49b8-bacf-84eac6b8600e service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received unexpected event network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 for instance with vm_state active and task_state None.
Jul 26 17:25:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:25:34 user nova-compute[70594]: INFO nova.compute.claims [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Claim successful on node user
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.network.neutron [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:25:34 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:25:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:34 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:25:35 user nova-compute[70594]: INFO nova.virt.block_device [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Booting with volume bdf6fff1-8602-40ee-9cc1-ffe4f9591673 at /dev/vda
Jul 26 17:25:35 user nova-compute[70594]: DEBUG nova.policy [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd221b17924ce3b9770c36fbbb52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f39be2f463416faaeae34d088bb57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG os_brick.utils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4285ec7c-d103-438c-b202-43aacae9f7bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5041d7-9c39-442c-934f-323f58e1820d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f349a2b-5001-41de-9ffc-c7df3a3d9537]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff597d-60c7-4ca5-9298-787c0e398db6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:25:35 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:25:35 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f809f-0119-44a9-afb9-bbaed92e0d73]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG os_brick.utils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating existing volume attachment record: 04fe4def-2dd0-4fed-b6a0-237fd4f2696a {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:25:35 user nova-compute[70594]: DEBUG nova.network.neutron [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Successfully created port: e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG nova.network.neutron [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Successfully updated port: e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquired lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG nova.network.neutron [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-changed-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG nova.compute.manager [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Refreshing instance network info cache due to event network-changed-e25d14b4-d60a-4ccb-a302-97b925d036d6. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] Acquiring lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:25:36 user nova-compute[70594]: DEBUG nova.network.neutron [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG nova.network.neutron [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Releasing lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Instance network_info: |[{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] Acquired lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Refreshing network info cache for port e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updated VIF entry in instance network info cache for port e25d14b4-d60a-4ccb-a302-97b925d036d6. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:25:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5006c791-86ff-4b5b-9627-0e931c76b0dd req-ec72d7d3-a3e6-4dd8-89c7-0be6521e9183 service nova] Releasing lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:25:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:25:42 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Creating image(s)
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Ensure instance console log exists: /opt/stack/data/nova/instances/b88832fc-c5af-4a5a-914b-f3028f1697a2/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Start _get_guest_xml network_info=[{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b88832fc-c5af-4a5a-914b-f3028f1697a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'serial': 'bdf6fff1-8602-40ee-9cc1-ffe4f9591673'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '04fe4def-2dd0-4fed-b6a0-237fd4f2696a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:25:42 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:25:42 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:25:42 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:25:42 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:25:42 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d36e6ee-c6b5-4385-8ab1-6ce5027e523b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:25:42 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e4ccf-b55c-4295-80d6-4caba274c8f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673] added
Jul 26 17:25:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24e342-0677-4674-8043-a775c7c503bf]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0fe27f-8698-4395-b14f-9af2c1163ded]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaAsoOUY {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaAsoOUY" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4045f9fe-3b3f-4c67-a64c-462ee8d5ace5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eaAsoOUY'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d194c22-e637-46a7-ab61-c8036876c0ac]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2593d4-6356-4936-b82d-b48d7e6534d1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 26 17:25:42 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 26 17:25:42 user nova-compute[70594]:  {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:25:42 user nova-compute[70594]: WARNING os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 26 17:25:42 user nova-compute[70594]: 
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeb7362-ce52-449a-ba00-a9b1a23e23c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]
Jul 26 17:25:42 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.
Jul 26 17:25:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65d7e74-376c-4d04-899d-e39f659b4148]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6153f125-252e-4bca-b1ad-51d23d7cd63f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:25:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:25:42 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df46bc-b45c-4abe-b9e3-789634d1eead]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:25:42 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26436303863626162', 'path': '/dev/sdb'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436303863626162', 'path': '/dev/sdb'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1574471287',display_name='tempest-TestVolumeBootPattern-server-1574471287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1574471287',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-2olmm36o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:25:35Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=b88832fc-c5af-4a5a-914b-f3028f1697a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'pci_devices' on Instance uuid b88832fc-c5af-4a5a-914b-f3028f1697a2 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:25:43 user nova-compute[70594]:   <uuid>b88832fc-c5af-4a5a-914b-f3028f1697a2</uuid>
Jul 26 17:25:43 user nova-compute[70594]:   <name>instance-00000031</name>
Jul 26 17:25:43 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:25:43 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:25:43 user nova-compute[70594]:   <metadata>
Jul 26 17:25:43 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:25:43 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:25:43 user nova-compute[70594]:       <nova:name>tempest-TestVolumeBootPattern-server-1574471287</nova:name>
Jul 26 17:25:43 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:25:42</nova:creationTime>
Jul 26 17:25:43 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:25:43 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:25:43 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:25:43 user nova-compute[70594]:       <nova:owner>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:user uuid="68fd221b17924ce3b9770c36fbbb52df">tempest-TestVolumeBootPattern-491432484-project-member</nova:user>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:project uuid="05f39be2f463416faaeae34d088bb57c">tempest-TestVolumeBootPattern-491432484</nova:project>
Jul 26 17:25:43 user nova-compute[70594]:       </nova:owner>
Jul 26 17:25:43 user nova-compute[70594]:       <nova:ports>
Jul 26 17:25:43 user nova-compute[70594]:         <nova:port uuid="e25d14b4-d60a-4ccb-a302-97b925d036d6">
Jul 26 17:25:43 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 26 17:25:43 user nova-compute[70594]:         </nova:port>
Jul 26 17:25:43 user nova-compute[70594]:       </nova:ports>
Jul 26 17:25:43 user nova-compute[70594]:     </nova:instance>
Jul 26 17:25:43 user nova-compute[70594]:   </metadata>
Jul 26 17:25:43 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:25:43 user nova-compute[70594]:     <system>
Jul 26 17:25:43 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:25:43 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:25:43 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:25:43 user nova-compute[70594]:       <entry name="serial">b88832fc-c5af-4a5a-914b-f3028f1697a2</entry>
Jul 26 17:25:43 user nova-compute[70594]:       <entry name="uuid">b88832fc-c5af-4a5a-914b-f3028f1697a2</entry>
Jul 26 17:25:43 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:25:43 user nova-compute[70594]:     </system>
Jul 26 17:25:43 user nova-compute[70594]:   </sysinfo>
Jul 26 17:25:43 user nova-compute[70594]:   <os>
Jul 26 17:25:43 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:25:43 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:25:43 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:25:43 user nova-compute[70594]:   </os>
Jul 26 17:25:43 user nova-compute[70594]:   <features>
Jul 26 17:25:43 user nova-compute[70594]:     <acpi/>
Jul 26 17:25:43 user nova-compute[70594]:     <apic/>
Jul 26 17:25:43 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:25:43 user nova-compute[70594]:   </features>
Jul 26 17:25:43 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:25:43 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:25:43 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:25:43 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:25:43 user nova-compute[70594]:   </clock>
Jul 26 17:25:43 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:25:43 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:25:43 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:25:43 user nova-compute[70594]:   </cpu>
Jul 26 17:25:43 user nova-compute[70594]:   <devices>
Jul 26 17:25:43 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:25:43 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:25:43 user nova-compute[70594]:       <source dev="/dev/sdb"/>
Jul 26 17:25:43 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:25:43 user nova-compute[70594]:       <serial>bdf6fff1-8602-40ee-9cc1-ffe4f9591673</serial>
Jul 26 17:25:43 user nova-compute[70594]:     </disk>
Jul 26 17:25:43 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:25:43 user nova-compute[70594]:       <mac address="fa:16:3e:47:d7:b0"/>
Jul 26 17:25:43 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:25:43 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:25:43 user nova-compute[70594]:       <target dev="tape25d14b4-d6"/>
Jul 26 17:25:43 user nova-compute[70594]:     </interface>
Jul 26 17:25:43 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:25:43 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/b88832fc-c5af-4a5a-914b-f3028f1697a2/console.log" append="off"/>
Jul 26 17:25:43 user nova-compute[70594]:     </serial>
Jul 26 17:25:43 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:25:43 user nova-compute[70594]:     <video>
Jul 26 17:25:43 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:25:43 user nova-compute[70594]:     </video>
Jul 26 17:25:43 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:25:43 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:25:43 user nova-compute[70594]:     </rng>
Jul 26 17:25:43 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:25:43 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:25:43 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:25:43 user nova-compute[70594]:     </memballoon>
Jul 26 17:25:43 user nova-compute[70594]:   </devices>
Jul 26 17:25:43 user nova-compute[70594]: </domain>
Jul 26 17:25:43 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1574471287',display_name='tempest-TestVolumeBootPattern-server-1574471287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1574471287',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-2olmm36o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:25:35Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=b88832fc-c5af-4a5a-914b-f3028f1697a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG os_vif [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape25d14b4-d6, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape25d14b4-d6, col_values=(('external_ids', {'iface-id': 'e25d14b4-d60a-4ccb-a302-97b925d036d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d7:b0', 'vm-uuid': 'b88832fc-c5af-4a5a-914b-f3028f1697a2'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:43 user nova-compute[70594]: INFO os_vif [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6')
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:25:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No VIF found with MAC fa:16:3e:47:d7:b0, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:25:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-b38dc3ed-a8f2-40fb-98dc-081caf9be52f req-fbbb3eea-c383-4a03-9830-158925941911 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b38dc3ed-a8f2-40fb-98dc-081caf9be52f req-fbbb3eea-c383-4a03-9830-158925941911 service nova] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b38dc3ed-a8f2-40fb-98dc-081caf9be52f req-fbbb3eea-c383-4a03-9830-158925941911 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b38dc3ed-a8f2-40fb-98dc-081caf9be52f req-fbbb3eea-c383-4a03-9830-158925941911 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-b38dc3ed-a8f2-40fb-98dc-081caf9be52f req-fbbb3eea-c383-4a03-9830-158925941911 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] No waiting events found dispatching network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:25:45 user nova-compute[70594]: WARNING nova.compute.manager [req-b38dc3ed-a8f2-40fb-98dc-081caf9be52f req-fbbb3eea-c383-4a03-9830-158925941911 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received unexpected event network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 for instance with vm_state building and task_state spawning.
Jul 26 17:25:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:45 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392347.1853318, b88832fc-c5af-4a5a-914b-f3028f1697a2 => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] VM Resumed (Lifecycle Event)
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Instance spawned successfully.
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392347.1910567, b88832fc-c5af-4a5a-914b-f3028f1697a2 => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] VM Started (Lifecycle Event)
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Took 5.16 seconds to spawn the instance on the hypervisor.
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:25:47 user nova-compute[70594]: INFO nova.compute.manager [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Took 12.80 seconds to build instance.
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cacd05ae-19a9-4e10-91ee-072bdca44d97 req-3d519b0a-988d-48bf-a9fc-446dd6121b32 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cacd05ae-19a9-4e10-91ee-072bdca44d97 req-3d519b0a-988d-48bf-a9fc-446dd6121b32 service nova] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cacd05ae-19a9-4e10-91ee-072bdca44d97 req-3d519b0a-988d-48bf-a9fc-446dd6121b32 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-cacd05ae-19a9-4e10-91ee-072bdca44d97 req-3d519b0a-988d-48bf-a9fc-446dd6121b32 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-cacd05ae-19a9-4e10-91ee-072bdca44d97 req-3d519b0a-988d-48bf-a9fc-446dd6121b32 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] No waiting events found dispatching network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:25:47 user nova-compute[70594]: WARNING nova.compute.manager [req-cacd05ae-19a9-4e10-91ee-072bdca44d97 req-3d519b0a-988d-48bf-a9fc-446dd6121b32 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received unexpected event network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 for instance with vm_state active and task_state None.
Jul 26 17:25:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-436de95f-b2a5-4092-8b1d-5923bb973d31 tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.915s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:25:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:25:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:03 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:08 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:13 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:18 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:26:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:26:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:26:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:26:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8391MB free_disk=25.25092315673828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:26:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 04f36f3f-8776-4d39-82fc-f464913f846f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 77065735-9358-4489-905f-f83e1a8f9869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance b88832fc-c5af-4a5a-914b-f3028f1697a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-changed-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Refreshing instance network info cache due to event network-changed-1c4eeb25-2562-4b7a-a768-3abf00ff6afc. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] Acquiring lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] Acquired lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:26:21 user nova-compute[70594]: DEBUG nova.network.neutron [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Refreshing network info cache for port 1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'flavor' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:26:22 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Ignoring supplied device name: /dev/vdb
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:26:22 user nova-compute[70594]: INFO nova.compute.manager [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Attaching volume d5d0af4d-3062-42a5-8b10-2df870ff28c9 to /dev/vdb
Jul 26 17:26:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updated VIF entry in instance network info cache for port 1c4eeb25-2562-4b7a-a768-3abf00ff6afc. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating instance_info_cache with network_info: [{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3494996f-8a05-48f5-8943-b0e1a187d950 req-d801e393-bade-4dad-8f71-93e213cfe8c5 service nova] Releasing lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG os_brick.utils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f609038-b983-4b4b-a0cd-e0545e7035ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace7cd2f-a035-4591-9715-92a274918a44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1605e61c-b27b-4210-9230-4c4bc5a91f01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e5e3d9-836c-4514-9465-64f0b5c7cc5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:26:22 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:26:22 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a018094-ed76-4be4-bf1d-b00f55f26044]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG os_brick.utils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:26:22 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating existing volume attachment record: d51d93ef-75ad-4a46-b7ba-2d3aaee00899 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:26:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:23 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:23 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:26:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:26:26 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:26:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating instance_info_cache with network_info: [{"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:26:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-04f36f3f-8776-4d39-82fc-f464913f846f" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:26:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIndqzBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:26:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:26:28 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:26:28 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2397a5e-30df-438b-a1a1-d2869d2578ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:26:28 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[187ffd80-129e-43d2-9e2e-f785c37feb1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9] added
Jul 26 17:26:28 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f40462-e674-4ce1-8592-10f700aab4ad]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9eb09a-282d-4869-b02a-4632dc44aac5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIndqzBu {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIndqzBu" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54e359-8dd3-47fc-ae40-8bb9be33a9b1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xIndqzBu'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[173636d2-4895-4127-8e2c-350281cabf27]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:28 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e218f-72ab-4332-a71f-39683e3eaed0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:26:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:26:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c5704-f605-4450-9f77-1f87918c0382]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260]
Jul 26 17:26:29 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260] successful.
Jul 26 17:26:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64562b-ace5-48d1-9f53-448990711636]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c66c99d-031f-4593-9505-47d044fc1307]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:26:29 user nova-compute[70594]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 (non-flash)
Jul 26 17:26:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:26:29 user nova-compute[70594]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 (non-flash)
Jul 26 17:26:29 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe86a276-f9cc-44c7-9fa9-14a205ae7187]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:26:29 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIndqzBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26365306235333632', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365306235333632', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG nova.objects.instance [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'flavor' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:26:30 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:26:30 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:26:30 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:26:30 user nova-compute[70594]:   <serial>d5d0af4d-3062-42a5-8b10-2df870ff28c9</serial>
Jul 26 17:26:30 user nova-compute[70594]: </disk>
Jul 26 17:26:30 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No VIF found with MAC fa:16:3e:e8:56:1e, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:26:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-d9320c05-42e9-4f5e-b93e-7e1cea89b9e3 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.439s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:26:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:33 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:48 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:26:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:26:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:26:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:26:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:26:53 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:58 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:26:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:26:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:26:58 user nova-compute[70594]: INFO nova.compute.manager [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Detaching volume d5d0af4d-3062-42a5-8b10-2df870ff28c9
Jul 26 17:26:59 user nova-compute[70594]: INFO nova.virt.block_device [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Attempting to driver detach volume d5d0af4d-3062-42a5-8b10-2df870ff28c9 from mountpoint /dev/vdb
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Attempting to detach device vdb from instance 04f36f3f-8776-4d39-82fc-f464913f846f from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:26:59 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:26:59 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:26:59 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:26:59 user nova-compute[70594]:   <serial>d5d0af4d-3062-42a5-8b10-2df870ff28c9</serial>
Jul 26 17:26:59 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:26:59 user nova-compute[70594]: </disk>
Jul 26 17:26:59 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:26:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully detached device vdb from instance 04f36f3f-8776-4d39-82fc-f464913f846f from the persistent domain config.
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04f36f3f-8776-4d39-82fc-f464913f846f from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:26:59 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:26:59 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:26:59 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:26:59 user nova-compute[70594]:   <serial>d5d0af4d-3062-42a5-8b10-2df870ff28c9</serial>
Jul 26 17:26:59 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:26:59 user nova-compute[70594]: </disk>
Jul 26 17:26:59 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690392419.5792453, 04f36f3f-8776-4d39-82fc-f464913f846f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:26:59 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully detached device vdb from instance 04f36f3f-8776-4d39-82fc-f464913f846f from the live domain config.
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIndqzBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:26:59 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf00b8-4e51-4fe1-b7f7-7228028470a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:26:59 user nova-compute[70594]: No targets found.
Jul 26 17:26:59 user nova-compute[70594]: iSNS:
Jul 26 17:26:59 user nova-compute[70594]: No targets found.
Jul 26 17:26:59 user nova-compute[70594]: STATIC:
Jul 26 17:26:59 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9
Jul 26 17:26:59 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:26:59 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:26:59 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:26:59 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:26:59 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:26:59 user nova-compute[70594]: FIRMWARE:
Jul 26 17:26:59 user nova-compute[70594]: No targets found.
Jul 26 17:26:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:26:59 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:26:59 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a5395-a769-4900-98a1-469cee27b466]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9655273-5e55-45c0-be0e-c0ad43b0a5c4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:26:59 user nova-compute[70594]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 (non-flash)
Jul 26 17:26:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:26:59 user nova-compute[70594]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 (non-flash)
Jul 26 17:26:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5918122cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652ab8e-119b-454f-ad91-ceb06340a6ef]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[868c430a-6bdd-486b-9ad9-7c8c672e16f7]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fe1b04-7dfb-403f-9be9-b365b6b5309e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba86bed-b2f2-4526-9828-8adba9bab9b5]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3551b1-576f-4b0e-af11-1a96202baf41]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e286558-2046-49f4-a787-e26d2b86b4dd]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260]
Jul 26 17:26:59 user nova-compute[70594]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9, portal: 172.16.0.220,3260] successful.
Jul 26 17:26:59 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34ecfb-da3a-46a9-b1ad-371c33a3257a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== disconnect_volume: return (283ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:26:59 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG nova.objects.instance [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'flavor' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-19f7df5a-0a5a-495f-80ad-675d2efd580e tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.570s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:00 user nova-compute[70594]: INFO nova.compute.manager [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Terminating instance
Jul 26 17:27:00 user nova-compute[70594]: DEBUG nova.compute.manager [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-d54d3a62-82e4-40f9-8a34-6ab7c3824fbe req-a71e9f56-c420-4d3f-9833-789cb4a718f9 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-vif-unplugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d54d3a62-82e4-40f9-8a34-6ab7c3824fbe req-a71e9f56-c420-4d3f-9833-789cb4a718f9 service nova] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d54d3a62-82e4-40f9-8a34-6ab7c3824fbe req-a71e9f56-c420-4d3f-9833-789cb4a718f9 service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-d54d3a62-82e4-40f9-8a34-6ab7c3824fbe req-a71e9f56-c420-4d3f-9833-789cb4a718f9 service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-d54d3a62-82e4-40f9-8a34-6ab7c3824fbe req-a71e9f56-c420-4d3f-9833-789cb4a718f9 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] No waiting events found dispatching network-vif-unplugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:27:00 user nova-compute[70594]: DEBUG nova.compute.manager [req-d54d3a62-82e4-40f9-8a34-6ab7c3824fbe req-a71e9f56-c420-4d3f-9833-789cb4a718f9 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-vif-unplugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:27:01 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Instance destroyed successfully.
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.objects.instance [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'resources' on Instance uuid 04f36f3f-8776-4d39-82fc-f464913f846f {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1802184836',display_name='tempest-VolumesSnapshotTestJSON-instance-1802184836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1802184836',id=47,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJgM7KHbV7ilzkAWIFcpNFvOLYRGSVmdCuI/hEPpvpQnT6e08z1azrg0jpKBQgJ25bPXVvgd+wA9F0b/yfnIgVHr7TX7C+D8J9BxzOnUYx97BRSKyjJRC4DWtiUBT7MLw==',key_name='tempest-keypair-1580717129',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:24:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee3473a9917a4c8db792409b139e8262',ramdisk_id='',reservation_id='r-r7vamuvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-953872237',owner_user_name='tempest-VolumesSnapshotTestJSON-953872237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceac1fcf58744384b3960b8c736ece77',uuid=04f36f3f-8776-4d39-82fc-f464913f846f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converting VIF {"id": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "address": "fa:16:3e:e8:56:1e", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4eeb25-25", "ovs_interfaceid": "1c4eeb25-2562-4b7a-a768-3abf00ff6afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_vif [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c4eeb25-25, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:27:01 user nova-compute[70594]: INFO os_vif [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=1c4eeb25-2562-4b7a-a768-3abf00ff6afc,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4eeb25-25')
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIndqzBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:01 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[35891ffe-9317-47bb-a516-b8ec957b3685]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:27:01 user nova-compute[70594]: No targets found.
Jul 26 17:27:01 user nova-compute[70594]: iSNS:
Jul 26 17:27:01 user nova-compute[70594]: No targets found.
Jul 26 17:27:01 user nova-compute[70594]: STATIC:
Jul 26 17:27:01 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:27:01 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:27:01 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:27:01 user nova-compute[70594]: FIRMWARE:
Jul 26 17:27:01 user nova-compute[70594]: No targets found.
Jul 26 17:27:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:27:01 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:27:01 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d0af4d-3062-42a5-8b10-2df870ff28c9', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d8e0ca-20b3-4be9-91fe-1f1ef9e1bc4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fa0f6-7ab1-4e26-b39e-d6751693f337]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:01 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5900507a30>, {}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Disconnecting from: [] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== disconnect_volume: return (73ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:27:01 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Deleting instance files /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f_del
Jul 26 17:27:01 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Deletion of /opt/stack/data/nova/instances/04f36f3f-8776-4d39-82fc-f464913f846f_del complete
Jul 26 17:27:01 user nova-compute[70594]: INFO nova.compute.manager [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 26 17:27:01 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:27:01 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:27:02 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Took 0.84 seconds to deallocate network for instance.
Jul 26 17:27:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-b27e2d04-b63f-4974-8f38-c22d7b38d8ee req-c27f41b8-a83e-4177-a11b-832fafa181dd service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-vif-deleted-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:02 user nova-compute[70594]: WARNING nova.volume.cinder [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Attachment d51d93ef-75ad-4a46-b7ba-2d3aaee00899 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d51d93ef-75ad-4a46-b7ba-2d3aaee00899. (HTTP 404) (Request-ID: req-30437d95-6b11-496f-9ba5-e4b0b3785ecc)
Jul 26 17:27:02 user nova-compute[70594]: INFO nova.compute.manager [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Took 0.03 seconds to detach 1 volumes for instance.
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:02 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Deleted allocations for instance 04f36f3f-8776-4d39-82fc-f464913f846f
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-4201a483-3100-42ba-8fdd-ab1ddd37e0b1 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "04f36f3f-8776-4d39-82fc-f464913f846f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.120s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-628394a8-25cc-43dc-a0ab-82cc36e360f8 req-2f6545fd-c873-4fed-8edd-54c8ceae9e16 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received event network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-628394a8-25cc-43dc-a0ab-82cc36e360f8 req-2f6545fd-c873-4fed-8edd-54c8ceae9e16 service nova] Acquiring lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-628394a8-25cc-43dc-a0ab-82cc36e360f8 req-2f6545fd-c873-4fed-8edd-54c8ceae9e16 service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-628394a8-25cc-43dc-a0ab-82cc36e360f8 req-2f6545fd-c873-4fed-8edd-54c8ceae9e16 service nova] Lock "04f36f3f-8776-4d39-82fc-f464913f846f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:02 user nova-compute[70594]: DEBUG nova.compute.manager [req-628394a8-25cc-43dc-a0ab-82cc36e360f8 req-2f6545fd-c873-4fed-8edd-54c8ceae9e16 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] No waiting events found dispatching network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:27:02 user nova-compute[70594]: WARNING nova.compute.manager [req-628394a8-25cc-43dc-a0ab-82cc36e360f8 req-2f6545fd-c873-4fed-8edd-54c8ceae9e16 service nova] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Received unexpected event network-vif-plugged-1c4eeb25-2562-4b7a-a768-3abf00ff6afc for instance with vm_state deleted and task_state None.
Jul 26 17:27:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:27:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:27:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:27:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:27:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:27:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-changed-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG nova.compute.manager [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Refreshing instance network info cache due to event network-changed-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] Acquiring lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] Acquired lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Refreshing network info cache for port 1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updated VIF entry in instance network info cache for port 1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG nova.network.neutron [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating instance_info_cache with network_info: [{"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-5b1f7729-fe2f-487e-9f7c-f385df59f770 req-f0e636ed-4350-4cf4-92e5-094f9f0ea3f6 service nova] Releasing lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'flavor' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:14 user nova-compute[70594]: INFO nova.compute.manager [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attaching volume 8cf0b61e-7cba-45cb-b477-228b80b81318 to /dev/vdb
Jul 26 17:27:14 user nova-compute[70594]: DEBUG os_brick.utils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[97959ace-2319-4e02-987c-df57a1513326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3a6d0d-4831-4825-8826-a30ccf625c93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c050f2eb-79f9-417e-9af3-0b81d64c096e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7fc0b3-27ca-4544-b3c7-eb300130ccc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:27:14 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:27:14 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d2503f-c610-4cbf-b7de-613a868966c7]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG os_brick.utils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:14 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating existing volume attachment record: ab7b92bc-c7ce-4a9e-b053-ba2ec51af480 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:27:16 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392421.3747697, 04f36f3f-8776-4d39-82fc-f464913f846f => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:27:16 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] VM Stopped (Lifecycle Event)
Jul 26 17:27:16 user nova-compute[70594]: DEBUG nova.compute.manager [None req-01bb71a7-ade0-4e47-9ddb-fc2ba11f7f46 None None] [instance: 04f36f3f-8776-4d39-82fc-f464913f846f] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:27:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:27:19 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:27:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:27:20 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=25.268692016601562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKzhcEWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:20 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:20 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb3168-49e9-4460-bd8a-64d8cc20a9ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:27:20 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0bb57-a6dc-4253-945f-16f96694f520]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318] added
Jul 26 17:27:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 77065735-9358-4489-905f-f83e1a8f9869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance b88832fc-c5af-4a5a-914b-f3028f1697a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ceb5b7-57d7-4822-8774-7195922e324d]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[012d8423-8838-4683-8d60-6ef72142f1b6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKzhcEWP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKzhcEWP" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf06571-be16-41f8-ba7c-b994df682d4b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DKzhcEWP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ae86a-74ba-48a0-a0e4-de9d01146d07]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[894367f4-2da7-4595-93e1-c865db3b7d66]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e083f77c-f44f-4c76-ade8-78b65306edcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260]
Jul 26 17:27:20 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260] successful.
Jul 26 17:27:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca5951-b0fd-424c-98a4-33eea6bec7cb]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[255aa218-fada-460c-8892-e160a205f33a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:20 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:20 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:20 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a6db6-6786-4fa0-8bd6-666b6d4aa8a1]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:27:20 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKzhcEWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:27:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23630346430633033', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630346430633033', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG nova.objects.instance [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'flavor' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:27:22 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:27:22 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:27:22 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:27:22 user nova-compute[70594]:   <serial>8cf0b61e-7cba-45cb-b477-228b80b81318</serial>
Jul 26 17:27:22 user nova-compute[70594]: </disk>
Jul 26 17:27:22 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No VIF found with MAC fa:16:3e:af:27:b1, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:27:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-5b598389-8e66-4558-87e8-3a55df712e4b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.554s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:24 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:27:25 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.objects.instance [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'flavor' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-changed-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.compute.manager [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Refreshing instance network info cache due to event network-changed-e25d14b4-d60a-4ccb-a302-97b925d036d6. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] Acquiring lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] Acquired lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Refreshing network info cache for port e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:26 user nova-compute[70594]: INFO nova.compute.manager [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attaching volume 5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 to /dev/vdc
Jul 26 17:27:26 user nova-compute[70594]: DEBUG os_brick.utils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702f0c1-b90f-4cf4-876a-598ab8849460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60fa2a4-7f5c-45ef-ba3f-67ffef748cfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa09d0-4413-469f-94b9-00e075123ba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0785ea07-a956-4963-9953-4cf488af8d32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:27:26 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d05db-63c0-42a4-9b64-464b6468dd4a]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG os_brick.utils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating existing volume attachment record: 76c23689-bbae-40d4-b6b8-1ce45411afe6 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updated VIF entry in instance network info cache for port e25d14b4-d60a-4ccb-a302-97b925d036d6. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.network.neutron [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-9ae40591-a193-4780-9b3d-b560b30d4488 req-4cc165bc-6dc0-46b9-b276-52e964e30ffe service nova] Releasing lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:27:26 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:27:27 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating instance_info_cache with network_info: [{"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:27:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-77065735-9358-4489-905f-f83e1a8f9869" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:27:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:27:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:27:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFIlTUpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:37 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:37 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:37 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3d265-91f9-4025-89c3-dba5138618f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:27:37 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c3f90a-7d1b-474a-a31c-c4c7bde0edcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6] added
Jul 26 17:27:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2114c-de4a-441c-b611-e2505c00cec1]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7aefe-e892-4d77-b1dd-3bb0a150e885]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFIlTUpZ {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFIlTUpZ" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a09fc-7027-4cf2-835f-96e2fd9cbd5a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oFIlTUpZ'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56d5ec4-56ae-4932-b09a-75aaff668233]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776d386-c64c-485f-b327-eca020eefc10]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5e30c5-cdcf-49ba-b48f-009e8f26062a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260]
Jul 26 17:27:37 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260] successful.
Jul 26 17:27:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd9c63f-37bb-4607-8581-3037013bda3c]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e0515-9293-40af-925a-1181ed8c9b14]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 (non-flash)
Jul 26 17:27:37 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d3b088-7ed1-411f-b6b8-ce38ab655df2]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:37 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFIlTUpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23632666463343036', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632666463343036', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.objects.instance [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'flavor' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:27:38 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:27:38 user nova-compute[70594]:   <source dev="/dev/sdd"/>
Jul 26 17:27:38 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:27:38 user nova-compute[70594]:   <serial>5249dd4e-8c5c-43f0-835a-9eec3d0c25c6</serial>
Jul 26 17:27:38 user nova-compute[70594]: </disk>
Jul 26 17:27:38 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:27:38 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] No VIF found with MAC fa:16:3e:af:27:b1, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:27:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-391de001-8c1d-4338-83bc-90f38f2dce6c tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.574s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:39 user nova-compute[70594]: INFO nova.compute.manager [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Detaching volume 5249dd4e-8c5c-43f0-835a-9eec3d0c25c6
Jul 26 17:27:39 user nova-compute[70594]: INFO nova.virt.block_device [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attempting to driver detach volume 5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 from mountpoint /dev/vdc
Jul 26 17:27:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Attempting to detach device vdc from instance 77065735-9358-4489-905f-f83e1a8f9869 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:27:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:27:39 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:27:39 user nova-compute[70594]:   <source dev="/dev/sdd"/>
Jul 26 17:27:39 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:27:39 user nova-compute[70594]:   <serial>5249dd4e-8c5c-43f0-835a-9eec3d0c25c6</serial>
Jul 26 17:27:39 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 26 17:27:39 user nova-compute[70594]: </disk>
Jul 26 17:27:39 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:27:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Successfully detached device vdc from instance 77065735-9358-4489-905f-f83e1a8f9869 from the persistent domain config.
Jul 26 17:27:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 77065735-9358-4489-905f-f83e1a8f9869 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:27:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:27:39 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:27:39 user nova-compute[70594]:   <source dev="/dev/sdd"/>
Jul 26 17:27:39 user nova-compute[70594]:   <target dev="vdc" bus="virtio"/>
Jul 26 17:27:39 user nova-compute[70594]:   <serial>5249dd4e-8c5c-43f0-835a-9eec3d0c25c6</serial>
Jul 26 17:27:39 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 26 17:27:39 user nova-compute[70594]: </disk>
Jul 26 17:27:39 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690392460.3535995, 77065735-9358-4489-905f-f83e1a8f9869 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:27:40 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Successfully detached device vdc from instance 77065735-9358-4489-905f-f83e1a8f9869 from the live domain config.
Jul 26 17:27:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFIlTUpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:40 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ce099-646a-4e19-b8a0-9dc42c7ffeb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:27:40 user nova-compute[70594]: No targets found.
Jul 26 17:27:40 user nova-compute[70594]: iSNS:
Jul 26 17:27:40 user nova-compute[70594]: No targets found.
Jul 26 17:27:40 user nova-compute[70594]: STATIC:
Jul 26 17:27:40 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6
Jul 26 17:27:40 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:27:40 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:27:40 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318
Jul 26 17:27:40 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:27:40 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:27:40 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:27:40 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:27:40 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:27:40 user nova-compute[70594]: FIRMWARE:
Jul 26 17:27:40 user nova-compute[70594]: No targets found.
Jul 26 17:27:40 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:27:40 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:27:40 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e4942f-baed-42ad-b55c-2b175e796f6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522e377-22f0-4258-a685-24a379dac2f2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:40 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:40 user nova-compute[70594]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 (non-flash)
Jul 26 17:27:40 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:40 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:40 user nova-compute[70594]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 (non-flash)
Jul 26 17:27:40 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59006e3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dc5bd3-6b9f-4030-8e92-1f8d929ef627]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ff7534-cd2d-483e-b2a0-8d61756bc926]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dcf486-2c46-44d5-a0f2-74d72f7e23ff]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd594173-94bf-4203-a239-bf4836663b90]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[791ea49f-fc88-48b0-a83a-e4776b9c03ea]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e6217-9ddc-4def-adb0-a52091728994]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260]
Jul 26 17:27:40 user nova-compute[70594]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6, portal: 172.16.0.220,3260] successful.
Jul 26 17:27:40 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5249dd4e-8c5c-43f0-835a-9eec3d0c25c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f186dd-1cfb-4101-80a4-3e39967aeeef]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] <== disconnect_volume: return (302ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:40 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:27:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'flavor' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-45de7e9c-5481-4d0b-b823-3c9c40c1130b tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.767s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:27:45 user nova-compute[70594]: INFO nova.compute.claims [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Claim successful on node user
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.network.neutron [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:27:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:27:45 user nova-compute[70594]: INFO nova.virt.block_device [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Booting with volume a30f1e2d-2c51-4068-81ba-232d4c563f1e at /dev/vda
Jul 26 17:27:45 user nova-compute[70594]: DEBUG nova.policy [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68fd221b17924ce3b9770c36fbbb52df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f39be2f463416faaeae34d088bb57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG os_brick.utils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcae8a48-edbe-41c8-9505-6cb6653ca2e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d517f86e-dd24-4b00-918c-33689bc6ac3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cec46-007d-4231-a512-4efe9ebc2ceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[309fe74a-1c0e-4f7c-b4c1-0c23bdf379e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:27:46 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:27:46 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c15af9-904c-4e82-be56-55af082c0ff5]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG os_brick.utils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updating existing volume attachment record: 47766132-e496-420d-9b2a-5860bd8bd6e1 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG nova.network.neutron [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Successfully created port: dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:27:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Successfully updated port: dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquired lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-changed-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Refreshing instance network info cache due to event network-changed-dd10f723-ad4a-4349-8447-212b3b7f1dc8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] Acquiring lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.network.neutron [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updating instance_info_cache with network_info: [{"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Releasing lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Instance network_info: |[{"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] Acquired lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:27:47 user nova-compute[70594]: DEBUG nova.network.neutron [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Refreshing network info cache for port dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:27:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updated VIF entry in instance network info cache for port dd10f723-ad4a-4349-8447-212b3b7f1dc8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:27:48 user nova-compute[70594]: DEBUG nova.network.neutron [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updating instance_info_cache with network_info: [{"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:27:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-ce635b06-a215-4315-bb56-70f9ce066b09 req-3c60c768-0fcb-42ab-bf37-4865d270f216 service nova] Releasing lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:27:51 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:27:52 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Creating image(s)
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Did not create local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Ensure instance console log exists: /opt/stack/data/nova/instances/15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Start _get_guest_xml network_info=[{"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIRzxikm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a30f1e2d-2c51-4068-81ba-232d4c563f1e', 'serial': 'a30f1e2d-2c51-4068-81ba-232d4c563f1e'}, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '47766132-e496-420d-9b2a-5860bd8bd6e1', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:27:52 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:27:52 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIRzxikm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:27:52 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:52 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:27:52 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[524fc2c3-6c68-4fd3-8df0-e8195b43f682]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:27:52 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d6b36-edf8-45fc-882e-b0b27d55387c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e] added
Jul 26 17:27:52 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb4f22-07f5-4bea-a346-9a7b3ce8d82e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4810c6-78fb-4afe-aa0c-ae90ae3550e3]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIRzxikm {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:52 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIRzxikm" returned: 0 in 0.041s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38d931-4be9-4a9f-aa33-12f58abdfe24]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uIRzxikm'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[41373d18-8968-4571-9840-a6e35e158996]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8661a1c-d4d9-476e-adbf-f1dfbc7ac8a3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:53 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:53 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:53 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:53 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[baffffcb-c16a-47f6-9627-f5f597fbfff8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260]
Jul 26 17:27:54 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260] successful.
Jul 26 17:27:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8801417-1acc-43a7-8545-7d2dae7350c6]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[154f0dbb-1ebd-49ad-8cfb-079fc0c8bd3e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:54 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:54 user nova-compute[70594]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)
Jul 26 17:27:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:27:54 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:27:54 user nova-compute[70594]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)
Jul 26 17:27:54 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.312s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[362aafcc-e43d-4a22-89f2-dc4ccf1f5325]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:27:54 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: None {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIRzxikm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.344s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== connect_volume: return (2346ms) {'type': 'block', 'scsi_wwn': '23661346663363030', 'path': '/dev/sdd'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661346663363030', 'path': '/dev/sdd'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-419756781',display_name='tempest-TestVolumeBootPattern-server-419756781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-419756781',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-z0ln65ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:27:46Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.objects.instance [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'pci_devices' on Instance uuid 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:27:55 user nova-compute[70594]:   <uuid>15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c</uuid>
Jul 26 17:27:55 user nova-compute[70594]:   <name>instance-00000032</name>
Jul 26 17:27:55 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:27:55 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:27:55 user nova-compute[70594]:   <metadata>
Jul 26 17:27:55 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:27:55 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:27:55 user nova-compute[70594]:       <nova:name>tempest-TestVolumeBootPattern-server-419756781</nova:name>
Jul 26 17:27:55 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:27:52</nova:creationTime>
Jul 26 17:27:55 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:27:55 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:27:55 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:27:55 user nova-compute[70594]:       <nova:owner>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:user uuid="68fd221b17924ce3b9770c36fbbb52df">tempest-TestVolumeBootPattern-491432484-project-member</nova:user>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:project uuid="05f39be2f463416faaeae34d088bb57c">tempest-TestVolumeBootPattern-491432484</nova:project>
Jul 26 17:27:55 user nova-compute[70594]:       </nova:owner>
Jul 26 17:27:55 user nova-compute[70594]:       <nova:ports>
Jul 26 17:27:55 user nova-compute[70594]:         <nova:port uuid="dd10f723-ad4a-4349-8447-212b3b7f1dc8">
Jul 26 17:27:55 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 26 17:27:55 user nova-compute[70594]:         </nova:port>
Jul 26 17:27:55 user nova-compute[70594]:       </nova:ports>
Jul 26 17:27:55 user nova-compute[70594]:     </nova:instance>
Jul 26 17:27:55 user nova-compute[70594]:   </metadata>
Jul 26 17:27:55 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:27:55 user nova-compute[70594]:     <system>
Jul 26 17:27:55 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:27:55 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:27:55 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:27:55 user nova-compute[70594]:       <entry name="serial">15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c</entry>
Jul 26 17:27:55 user nova-compute[70594]:       <entry name="uuid">15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c</entry>
Jul 26 17:27:55 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:27:55 user nova-compute[70594]:     </system>
Jul 26 17:27:55 user nova-compute[70594]:   </sysinfo>
Jul 26 17:27:55 user nova-compute[70594]:   <os>
Jul 26 17:27:55 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:27:55 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:27:55 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:27:55 user nova-compute[70594]:   </os>
Jul 26 17:27:55 user nova-compute[70594]:   <features>
Jul 26 17:27:55 user nova-compute[70594]:     <acpi/>
Jul 26 17:27:55 user nova-compute[70594]:     <apic/>
Jul 26 17:27:55 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:27:55 user nova-compute[70594]:   </features>
Jul 26 17:27:55 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:27:55 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:27:55 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:27:55 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:27:55 user nova-compute[70594]:   </clock>
Jul 26 17:27:55 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:27:55 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:27:55 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:27:55 user nova-compute[70594]:   </cpu>
Jul 26 17:27:55 user nova-compute[70594]:   <devices>
Jul 26 17:27:55 user nova-compute[70594]:     <disk type="block" device="disk">
Jul 26 17:27:55 user nova-compute[70594]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:27:55 user nova-compute[70594]:       <source dev="/dev/sdd"/>
Jul 26 17:27:55 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:27:55 user nova-compute[70594]:       <serial>a30f1e2d-2c51-4068-81ba-232d4c563f1e</serial>
Jul 26 17:27:55 user nova-compute[70594]:     </disk>
Jul 26 17:27:55 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:27:55 user nova-compute[70594]:       <mac address="fa:16:3e:97:a6:70"/>
Jul 26 17:27:55 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:27:55 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:27:55 user nova-compute[70594]:       <target dev="tapdd10f723-ad"/>
Jul 26 17:27:55 user nova-compute[70594]:     </interface>
Jul 26 17:27:55 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:27:55 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c/console.log" append="off"/>
Jul 26 17:27:55 user nova-compute[70594]:     </serial>
Jul 26 17:27:55 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:27:55 user nova-compute[70594]:     <video>
Jul 26 17:27:55 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:27:55 user nova-compute[70594]:     </video>
Jul 26 17:27:55 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:27:55 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:27:55 user nova-compute[70594]:     </rng>
Jul 26 17:27:55 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:27:55 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:27:55 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:27:55 user nova-compute[70594]:     </memballoon>
Jul 26 17:27:55 user nova-compute[70594]:   </devices>
Jul 26 17:27:55 user nova-compute[70594]: </domain>
Jul 26 17:27:55 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-419756781',display_name='tempest-TestVolumeBootPattern-server-419756781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-419756781',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-z0ln65ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:27:46Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG os_vif [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd10f723-ad, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd10f723-ad, col_values=(('external_ids', {'iface-id': 'dd10f723-ad4a-4349-8447-212b3b7f1dc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:a6:70', 'vm-uuid': '15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:55 user nova-compute[70594]: INFO os_vif [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad')
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:27:55 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] No VIF found with MAC fa:16:3e:97:a6:70, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-dbe924ef-252c-456b-a20c-2ec95ccce4cd req-06266a91-7343-4928-9681-9336f18539a9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dbe924ef-252c-456b-a20c-2ec95ccce4cd req-06266a91-7343-4928-9681-9336f18539a9 service nova] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dbe924ef-252c-456b-a20c-2ec95ccce4cd req-06266a91-7343-4928-9681-9336f18539a9 service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-dbe924ef-252c-456b-a20c-2ec95ccce4cd req-06266a91-7343-4928-9681-9336f18539a9 service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:56 user nova-compute[70594]: DEBUG nova.compute.manager [req-dbe924ef-252c-456b-a20c-2ec95ccce4cd req-06266a91-7343-4928-9681-9336f18539a9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] No waiting events found dispatching network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:27:56 user nova-compute[70594]: WARNING nova.compute.manager [req-dbe924ef-252c-456b-a20c-2ec95ccce4cd req-06266a91-7343-4928-9681-9336f18539a9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received unexpected event network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 for instance with vm_state building and task_state spawning.
Jul 26 17:27:56 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392478.6094942, 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] VM Resumed (Lifecycle Event)
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Instance spawned successfully.
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392478.611126, 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] VM Started (Lifecycle Event)
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Took 5.95 seconds to spawn the instance on the hypervisor.
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:27:58 user nova-compute[70594]: INFO nova.compute.manager [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Took 13.28 seconds to build instance.
Jul 26 17:27:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-69dba0e5-efe2-400f-8a65-f51a7e94541c tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.372s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-2396e9ef-bd2c-4e0a-8e8c-89ab01fc7139 req-5e08cd83-2148-44df-bcd9-4b367e75f9b5 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2396e9ef-bd2c-4e0a-8e8c-89ab01fc7139 req-5e08cd83-2148-44df-bcd9-4b367e75f9b5 service nova] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2396e9ef-bd2c-4e0a-8e8c-89ab01fc7139 req-5e08cd83-2148-44df-bcd9-4b367e75f9b5 service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2396e9ef-bd2c-4e0a-8e8c-89ab01fc7139 req-5e08cd83-2148-44df-bcd9-4b367e75f9b5 service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:27:58 user nova-compute[70594]: DEBUG nova.compute.manager [req-2396e9ef-bd2c-4e0a-8e8c-89ab01fc7139 req-5e08cd83-2148-44df-bcd9-4b367e75f9b5 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] No waiting events found dispatching network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:27:58 user nova-compute[70594]: WARNING nova.compute.manager [req-2396e9ef-bd2c-4e0a-8e8c-89ab01fc7139 req-5e08cd83-2148-44df-bcd9-4b367e75f9b5 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received unexpected event network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 for instance with vm_state active and task_state None.
Jul 26 17:28:00 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:01 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:05 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:10 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Starting instance... {{(pid=70594) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70594) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 26 17:28:12 user nova-compute[70594]: INFO nova.compute.claims [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Claim successful on node user
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Start building networks asynchronously for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Allocating IP information in the background. {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] allocate_for_instance() {{(pid=70594) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 26 17:28:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Start building block device mappings for instance. {{(pid=70594) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.policy [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceac1fcf58744384b3960b8c736ece77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3473a9917a4c8db792409b139e8262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70594) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Start spawning the instance on the hypervisor. {{(pid=70594) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Creating instance directory {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 26 17:28:12 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Creating image(s)
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "/opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "/opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:12 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.138s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "82b92676a715892f34647bebf07816472e30d14b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk 1073741824 {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b,backing_fmt=raw /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk 1073741824" returned: 0 in 0.054s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "82b92676a715892f34647bebf07816472e30d14b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b92676a715892f34647bebf07816472e30d14b --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk. size=1073741824 {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Successfully created port: 41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG nova.virt.disk.api [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Cannot resize image /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk to a smaller size. {{(pid=70594) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'migration_context' on Instance uuid 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Created local disks {{(pid=70594) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Ensure instance console log exists: /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/console.log {{(pid=70594) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:13 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Successfully updated port: 41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquired lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Building network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-changed-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.compute.manager [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Refreshing instance network info cache due to event network-changed-41d36c7c-01ae-4976-be25-401bcd88c55a. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] Acquiring lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Instance cache missing network info. {{(pid=70594) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.neutron [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updating instance_info_cache with network_info: [{"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Releasing lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Instance network_info: |[{"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70594) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] Acquired lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.neutron [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Refreshing network info cache for port 41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Start _get_guest_xml network_info=[{"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'eb0188fe-f507-4fcc-b390-0fd03c1cea08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 26 17:28:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:28:14 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CPU controller missing on host. {{(pid=70594) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.host [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CPU controller found on host. {{(pid=70594) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70594) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-26T16:54:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-26T16:54:19Z,direct_url=<?>,disk_format='qcow2',id=eb0188fe-f507-4fcc-b390-0fd03c1cea08,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d3cbf5335a224282b3b62a3bb9fd2dbb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-26T16:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Flavor limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Image limits 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Flavor pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Image pref 0:0:0 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Got 1 possible topologies {{(pid=70594) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.hardware [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70594) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-362998791',display_name='tempest-VolumesSnapshotTestJSON-instance-362998791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-362998791',id=51,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLo9hJ3j51wTX+LNJZGCUuNDG0Q60EDSdXoFJWp85cxXZvh77iZhsKs0AympdUbxMwIlldDTaAbbR5lGIGJ7C7D+JXq7TgKJNCALce9wMBoEGpb8+lWQUzoaKMSaEXc6g==',key_name='tempest-keypair-1361925694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee3473a9917a4c8db792409b139e8262',ramdisk_id='',reservation_id='r-0sd6eb0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-953872237',owner_user_name='tempest-VolumesSnapshotTestJSON-953872237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceac1fcf58744384b3960b8c736ece77',uuid=3fc57686-9a41-42a9-ba9e-331eac88a3fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70594) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converting VIF {"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.objects.instance [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] End _get_guest_xml xml=<domain type="kvm">
Jul 26 17:28:14 user nova-compute[70594]:   <uuid>3fc57686-9a41-42a9-ba9e-331eac88a3fa</uuid>
Jul 26 17:28:14 user nova-compute[70594]:   <name>instance-00000033</name>
Jul 26 17:28:14 user nova-compute[70594]:   <memory>524288</memory>
Jul 26 17:28:14 user nova-compute[70594]:   <vcpu>1</vcpu>
Jul 26 17:28:14 user nova-compute[70594]:   <metadata>
Jul 26 17:28:14 user nova-compute[70594]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 26 17:28:14 user nova-compute[70594]:       <nova:package version="0.0.0"/>
Jul 26 17:28:14 user nova-compute[70594]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-362998791</nova:name>
Jul 26 17:28:14 user nova-compute[70594]:       <nova:creationTime>2023-07-26 17:28:14</nova:creationTime>
Jul 26 17:28:14 user nova-compute[70594]:       <nova:flavor name="m1.tiny">
Jul 26 17:28:14 user nova-compute[70594]:         <nova:memory>512</nova:memory>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:disk>1</nova:disk>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:swap>0</nova:swap>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:ephemeral>0</nova:ephemeral>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:vcpus>1</nova:vcpus>
Jul 26 17:28:14 user nova-compute[70594]:       </nova:flavor>
Jul 26 17:28:14 user nova-compute[70594]:       <nova:owner>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:user uuid="ceac1fcf58744384b3960b8c736ece77">tempest-VolumesSnapshotTestJSON-953872237-project-member</nova:user>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:project uuid="ee3473a9917a4c8db792409b139e8262">tempest-VolumesSnapshotTestJSON-953872237</nova:project>
Jul 26 17:28:14 user nova-compute[70594]:       </nova:owner>
Jul 26 17:28:14 user nova-compute[70594]:       <nova:root type="image" uuid="eb0188fe-f507-4fcc-b390-0fd03c1cea08"/>
Jul 26 17:28:14 user nova-compute[70594]:       <nova:ports>
Jul 26 17:28:14 user nova-compute[70594]:         <nova:port uuid="41d36c7c-01ae-4976-be25-401bcd88c55a">
Jul 26 17:28:14 user nova-compute[70594]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 26 17:28:14 user nova-compute[70594]:         </nova:port>
Jul 26 17:28:14 user nova-compute[70594]:       </nova:ports>
Jul 26 17:28:14 user nova-compute[70594]:     </nova:instance>
Jul 26 17:28:14 user nova-compute[70594]:   </metadata>
Jul 26 17:28:14 user nova-compute[70594]:   <sysinfo type="smbios">
Jul 26 17:28:14 user nova-compute[70594]:     <system>
Jul 26 17:28:14 user nova-compute[70594]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 26 17:28:14 user nova-compute[70594]:       <entry name="product">OpenStack Nova</entry>
Jul 26 17:28:14 user nova-compute[70594]:       <entry name="version">0.0.0</entry>
Jul 26 17:28:14 user nova-compute[70594]:       <entry name="serial">3fc57686-9a41-42a9-ba9e-331eac88a3fa</entry>
Jul 26 17:28:14 user nova-compute[70594]:       <entry name="uuid">3fc57686-9a41-42a9-ba9e-331eac88a3fa</entry>
Jul 26 17:28:14 user nova-compute[70594]:       <entry name="family">Virtual Machine</entry>
Jul 26 17:28:14 user nova-compute[70594]:     </system>
Jul 26 17:28:14 user nova-compute[70594]:   </sysinfo>
Jul 26 17:28:14 user nova-compute[70594]:   <os>
Jul 26 17:28:14 user nova-compute[70594]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 26 17:28:14 user nova-compute[70594]:     <boot dev="hd"/>
Jul 26 17:28:14 user nova-compute[70594]:     <smbios mode="sysinfo"/>
Jul 26 17:28:14 user nova-compute[70594]:   </os>
Jul 26 17:28:14 user nova-compute[70594]:   <features>
Jul 26 17:28:14 user nova-compute[70594]:     <acpi/>
Jul 26 17:28:14 user nova-compute[70594]:     <apic/>
Jul 26 17:28:14 user nova-compute[70594]:     <vmcoreinfo/>
Jul 26 17:28:14 user nova-compute[70594]:   </features>
Jul 26 17:28:14 user nova-compute[70594]:   <clock offset="utc">
Jul 26 17:28:14 user nova-compute[70594]:     <timer name="pit" tickpolicy="delay"/>
Jul 26 17:28:14 user nova-compute[70594]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 26 17:28:14 user nova-compute[70594]:     <timer name="hpet" present="no"/>
Jul 26 17:28:14 user nova-compute[70594]:   </clock>
Jul 26 17:28:14 user nova-compute[70594]:   <cpu mode="custom" match="exact">
Jul 26 17:28:14 user nova-compute[70594]:     <model>Nehalem</model>
Jul 26 17:28:14 user nova-compute[70594]:     <topology sockets="1" cores="1" threads="1"/>
Jul 26 17:28:14 user nova-compute[70594]:   </cpu>
Jul 26 17:28:14 user nova-compute[70594]:   <devices>
Jul 26 17:28:14 user nova-compute[70594]:     <disk type="file" device="disk">
Jul 26 17:28:14 user nova-compute[70594]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 26 17:28:14 user nova-compute[70594]:       <source file="/opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk"/>
Jul 26 17:28:14 user nova-compute[70594]:       <target dev="vda" bus="virtio"/>
Jul 26 17:28:14 user nova-compute[70594]:     </disk>
Jul 26 17:28:14 user nova-compute[70594]:     <interface type="ethernet">
Jul 26 17:28:14 user nova-compute[70594]:       <mac address="fa:16:3e:43:2c:54"/>
Jul 26 17:28:14 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:28:14 user nova-compute[70594]:       <mtu size="1442"/>
Jul 26 17:28:14 user nova-compute[70594]:       <target dev="tap41d36c7c-01"/>
Jul 26 17:28:14 user nova-compute[70594]:     </interface>
Jul 26 17:28:14 user nova-compute[70594]:     <serial type="pty">
Jul 26 17:28:14 user nova-compute[70594]:       <log file="/opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/console.log" append="off"/>
Jul 26 17:28:14 user nova-compute[70594]:     </serial>
Jul 26 17:28:14 user nova-compute[70594]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 26 17:28:14 user nova-compute[70594]:     <video>
Jul 26 17:28:14 user nova-compute[70594]:       <model type="virtio"/>
Jul 26 17:28:14 user nova-compute[70594]:     </video>
Jul 26 17:28:14 user nova-compute[70594]:     <rng model="virtio">
Jul 26 17:28:14 user nova-compute[70594]:       <backend model="random">/dev/urandom</backend>
Jul 26 17:28:14 user nova-compute[70594]:     </rng>
Jul 26 17:28:14 user nova-compute[70594]:     <controller type="usb" index="0" model="none"/>
Jul 26 17:28:14 user nova-compute[70594]:     <memballoon model="virtio">
Jul 26 17:28:14 user nova-compute[70594]:       <stats period="10"/>
Jul 26 17:28:14 user nova-compute[70594]:     </memballoon>
Jul 26 17:28:14 user nova-compute[70594]:   </devices>
Jul 26 17:28:14 user nova-compute[70594]: </domain>
Jul 26 17:28:14 user nova-compute[70594]:  {{(pid=70594) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-362998791',display_name='tempest-VolumesSnapshotTestJSON-instance-362998791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-362998791',id=51,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLo9hJ3j51wTX+LNJZGCUuNDG0Q60EDSdXoFJWp85cxXZvh77iZhsKs0AympdUbxMwIlldDTaAbbR5lGIGJ7C7D+JXq7TgKJNCALce9wMBoEGpb8+lWQUzoaKMSaEXc6g==',key_name='tempest-keypair-1361925694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee3473a9917a4c8db792409b139e8262',ramdisk_id='',reservation_id='r-0sd6eb0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-953872237',owner_user_name='tempest-VolumesSnapshotTestJSON-953872237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-26T17:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceac1fcf58744384b3960b8c736ece77',uuid=3fc57686-9a41-42a9-ba9e-331eac88a3fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converting VIF {"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG os_vif [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01') {{(pid=70594) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d36c7c-01, may_exist=True, interface_attrs={}) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41d36c7c-01, col_values=(('external_ids', {'iface-id': '41d36c7c-01ae-4976-be25-401bcd88c55a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:2c:54', 'vm-uuid': '3fc57686-9a41-42a9-ba9e-331eac88a3fa'}),), if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:14 user nova-compute[70594]: INFO os_vif [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01')
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:28:14 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No VIF found with MAC fa:16:3e:43:2c:54, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:28:15 user nova-compute[70594]: DEBUG nova.network.neutron [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updated VIF entry in instance network info cache for port 41d36c7c-01ae-4976-be25-401bcd88c55a. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:28:15 user nova-compute[70594]: DEBUG nova.network.neutron [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updating instance_info_cache with network_info: [{"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:28:15 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-b77c01eb-8683-45a9-b175-f0bb481b78d3 req-b0fd4e6c-a64b-4188-8912-8b6db8182531 service nova] Releasing lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-8921bd91-1826-4af4-95b3-5334322fb54c req-bd79b1ae-e548-43b4-8f81-56164ae464cc service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8921bd91-1826-4af4-95b3-5334322fb54c req-bd79b1ae-e548-43b4-8f81-56164ae464cc service nova] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8921bd91-1826-4af4-95b3-5334322fb54c req-bd79b1ae-e548-43b4-8f81-56164ae464cc service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-8921bd91-1826-4af4-95b3-5334322fb54c req-bd79b1ae-e548-43b4-8f81-56164ae464cc service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG nova.compute.manager [req-8921bd91-1826-4af4-95b3-5334322fb54c req-bd79b1ae-e548-43b4-8f81-56164ae464cc service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] No waiting events found dispatching network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:28:16 user nova-compute[70594]: WARNING nova.compute.manager [req-8921bd91-1826-4af4-95b3-5334322fb54c req-bd79b1ae-e548-43b4-8f81-56164ae464cc service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received unexpected event network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a for instance with vm_state building and task_state spawning.
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:16 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392498.262109, 3fc57686-9a41-42a9-ba9e-331eac88a3fa => Resumed> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] VM Resumed (Lifecycle Event)
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Instance event wait completed in 0 seconds for  {{(pid=70594) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Guest created on hypervisor {{(pid=70594) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Instance spawned successfully.
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Found default for hw_cdrom_bus of ide {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Found default for hw_disk_bus of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Found default for hw_input_bus of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Found default for hw_pointer_model of None {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Found default for hw_video_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Found default for hw_vif_model of virtio {{(pid=70594) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.virt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Emitting event <LifecycleEvent: 1690392498.2641406, 3fc57686-9a41-42a9-ba9e-331eac88a3fa => Started> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] VM Started (Lifecycle Event)
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70594) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.compute.manager [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Took 5.51 seconds to spawn the instance on the hypervisor.
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-80112ec6-4b11-4f8d-907d-0dea4c540489 req-b7712f33-b768-4eab-a8e6-2e62451f6e67 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-80112ec6-4b11-4f8d-907d-0dea4c540489 req-b7712f33-b768-4eab-a8e6-2e62451f6e67 service nova] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-80112ec6-4b11-4f8d-907d-0dea4c540489 req-b7712f33-b768-4eab-a8e6-2e62451f6e67 service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-80112ec6-4b11-4f8d-907d-0dea4c540489 req-b7712f33-b768-4eab-a8e6-2e62451f6e67 service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:18 user nova-compute[70594]: DEBUG nova.compute.manager [req-80112ec6-4b11-4f8d-907d-0dea4c540489 req-b7712f33-b768-4eab-a8e6-2e62451f6e67 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] No waiting events found dispatching network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:28:18 user nova-compute[70594]: WARNING nova.compute.manager [req-80112ec6-4b11-4f8d-907d-0dea4c540489 req-b7712f33-b768-4eab-a8e6-2e62451f6e67 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received unexpected event network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a for instance with vm_state building and task_state spawning.
Jul 26 17:28:18 user nova-compute[70594]: INFO nova.compute.manager [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Took 6.08 seconds to build instance.
Jul 26 17:28:18 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-2ded2c66-5136-4185-898f-672126cd06dc tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.181s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:28:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:28:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:28:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.264240264892578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 77065735-9358-4489-905f-f83e1a8f9869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance b88832fc-c5af-4a5a-914b-f3028f1697a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:28:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:28:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:29 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:28:30 user nova-compute[70594]: INFO nova.compute.manager [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Detaching volume 8cf0b61e-7cba-45cb-b477-228b80b81318
Jul 26 17:28:30 user nova-compute[70594]: INFO nova.virt.block_device [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Attempting to driver detach volume 8cf0b61e-7cba-45cb-b477-228b80b81318 from mountpoint /dev/vdb
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Attempting to detach device vdb from instance 77065735-9358-4489-905f-f83e1a8f9869 from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:28:30 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:28:30 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:28:30 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:28:30 user nova-compute[70594]:   <serial>8cf0b61e-7cba-45cb-b477-228b80b81318</serial>
Jul 26 17:28:30 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:28:30 user nova-compute[70594]: </disk>
Jul 26 17:28:30 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:28:30 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Successfully detached device vdb from instance 77065735-9358-4489-905f-f83e1a8f9869 from the persistent domain config.
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77065735-9358-4489-905f-f83e1a8f9869 from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:28:30 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:28:30 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:28:30 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:28:30 user nova-compute[70594]:   <serial>8cf0b61e-7cba-45cb-b477-228b80b81318</serial>
Jul 26 17:28:30 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:28:30 user nova-compute[70594]: </disk>
Jul 26 17:28:30 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690392510.8103194, 77065735-9358-4489-905f-f83e1a8f9869 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:28:30 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Successfully detached device vdb from instance 77065735-9358-4489-905f-f83e1a8f9869 from the live domain config.
Jul 26 17:28:30 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKzhcEWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:28:30 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9854e166-8af5-4bae-b422-8bb607e3000a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:28:30 user nova-compute[70594]: No targets found.
Jul 26 17:28:30 user nova-compute[70594]: iSNS:
Jul 26 17:28:30 user nova-compute[70594]: No targets found.
Jul 26 17:28:30 user nova-compute[70594]: STATIC:
Jul 26 17:28:30 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318
Jul 26 17:28:30 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:28:30 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:28:30 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e
Jul 26 17:28:30 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:28:30 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:28:30 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:28:30 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:28:30 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:28:30 user nova-compute[70594]: FIRMWARE:
Jul 26 17:28:30 user nova-compute[70594]: No targets found.
Jul 26 17:28:30 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:28:30 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:28:30 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc8e6f1-aa12-435e-a327-1ad73c23eb86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dbb958-5654-437d-87fd-112505c4b167]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:28:30 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:28:30 user nova-compute[70594]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)
Jul 26 17:28:30 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:28:30 user nova-compute[70594]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 (non-flash)
Jul 26 17:28:30 user nova-compute[70594]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)
Jul 26 17:28:30 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59006e17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d930ab6-adc1-490d-91a4-c73513b01b8f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7035b-c15f-41e1-95e6-82cd74c01bf7]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09c586e-b0f5-47e6-95aa-9fb81c907ffe]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:28:30 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7462203-77fa-448c-8da4-366e4c58d1be]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436ee0c-c311-4ea7-b989-10f9490c560b]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[261c3434-66ed-4196-9497-cc6fb57f031f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260]
Jul 26 17:28:31 user nova-compute[70594]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318, portal: 172.16.0.220,3260] successful.
Jul 26 17:28:31 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0b61e-7cba-45cb-b477-228b80b81318 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ae83bb-2327-445c-a965-8eb185f539b5]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] <== disconnect_volume: return (303ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:28:31 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:28:32 user nova-compute[70594]: DEBUG nova.objects.instance [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'flavor' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:28:32 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-af8448f5-94d1-4ac9-89a5-c50f69289031 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.852s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:28:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:28:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:28:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:29:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:29:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:29:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:20 user nova-compute[70594]: INFO nova.compute.manager [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Terminating instance
Jul 26 17:29:20 user nova-compute[70594]: DEBUG nova.compute.manager [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:20 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-a7cbb25a-c470-4683-a1f1-b6ac829d9bbd req-b9b0270a-7700-48b3-842a-3419e7d11a45 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-vif-unplugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a7cbb25a-c470-4683-a1f1-b6ac829d9bbd req-b9b0270a-7700-48b3-842a-3419e7d11a45 service nova] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a7cbb25a-c470-4683-a1f1-b6ac829d9bbd req-b9b0270a-7700-48b3-842a-3419e7d11a45 service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-a7cbb25a-c470-4683-a1f1-b6ac829d9bbd req-b9b0270a-7700-48b3-842a-3419e7d11a45 service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-a7cbb25a-c470-4683-a1f1-b6ac829d9bbd req-b9b0270a-7700-48b3-842a-3419e7d11a45 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] No waiting events found dispatching network-vif-unplugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.compute.manager [req-a7cbb25a-c470-4683-a1f1-b6ac829d9bbd req-b9b0270a-7700-48b3-842a-3419e7d11a45 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-vif-unplugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Instance destroyed successfully.
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.objects.instance [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lazy-loading 'resources' on Instance uuid 77065735-9358-4489-905f-f83e1a8f9869 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1099594416',display_name='tempest-TestServerVolumeAttachmentScenario-server-1099594416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1099594416',id=48,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwiRHQ9fhjZ+tROMZtrxe+0WtGXBc9zNdm3uU2Ij8BXRWPgMSpyUZ2ubdwc6vtWZFmHFGLN2PrQ1pwkW+Upt7gODvAk7AvZlNpH5SwIDfdfY+vUYDMLdw0wR7KCWFTvWw==',key_name='tempest-keypair-1841940591',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a6cb23095c24696867e34cec0b6f114',ramdisk_id='',reservation_id='r-l5iycnpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1663160358',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1663160358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6297345c1eda4576b56e7d0a05873fd5',uuid=77065735-9358-4489-905f-f83e1a8f9869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Converting VIF {"id": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "address": "fa:16:3e:af:27:b1", "network": {"id": "5a2de9b9-0b6f-42e7-b211-d8ad240df179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1960858974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a6cb23095c24696867e34cec0b6f114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cbeb7a3-1a", "ovs_interfaceid": "1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG os_vif [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cbeb7a3-1a, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:21 user nova-compute[70594]: INFO os_vif [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2,network=Network(5a2de9b9-0b6f-42e7-b211-d8ad240df179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cbeb7a3-1a')
Jul 26 17:29:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Deleting instance files /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869_del
Jul 26 17:29:21 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Deletion of /opt/stack/data/nova/instances/77065735-9358-4489-905f-f83e1a8f9869_del complete
Jul 26 17:29:21 user nova-compute[70594]: INFO nova.compute.manager [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:29:21 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-9291adf6-e1ea-4d21-b0c9-c665b42471b1 req-f4c8039e-a837-426c-bf23-07097f79b1e5 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-vif-deleted-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:22 user nova-compute[70594]: INFO nova.compute.manager [req-9291adf6-e1ea-4d21-b0c9-c665b42471b1 req-f4c8039e-a837-426c-bf23-07097f79b1e5 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Neutron deleted interface 1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2; detaching it from the instance and deleting it from the info cache
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.network.neutron [req-9291adf6-e1ea-4d21-b0c9-c665b42471b1 req-f4c8039e-a837-426c-bf23-07097f79b1e5 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:29:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:29:22 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.263397216796875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.manager [req-9291adf6-e1ea-4d21-b0c9-c665b42471b1 req-f4c8039e-a837-426c-bf23-07097f79b1e5 service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Detach interface failed, port_id=1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2, reason: Instance 77065735-9358-4489-905f-f83e1a8f9869 could not be found. {{(pid=70594) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 26 17:29:22 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Took 1.17 seconds to deallocate network for instance.
Jul 26 17:29:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 77065735-9358-4489-905f-f83e1a8f9869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance b88832fc-c5af-4a5a-914b-f3028f1697a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:29:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.283s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-e29d89b0-f237-4692-b920-903194c4f5b5 req-8b0f6ab9-c4bc-48d8-8582-171a6866856d service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received event network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e29d89b0-f237-4692-b920-903194c4f5b5 req-8b0f6ab9-c4bc-48d8-8582-171a6866856d service nova] Acquiring lock "77065735-9358-4489-905f-f83e1a8f9869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e29d89b0-f237-4692-b920-903194c4f5b5 req-8b0f6ab9-c4bc-48d8-8582-171a6866856d service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e29d89b0-f237-4692-b920-903194c4f5b5 req-8b0f6ab9-c4bc-48d8-8582-171a6866856d service nova] Lock "77065735-9358-4489-905f-f83e1a8f9869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.compute.manager [req-e29d89b0-f237-4692-b920-903194c4f5b5 req-8b0f6ab9-c4bc-48d8-8582-171a6866856d service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] No waiting events found dispatching network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:29:23 user nova-compute[70594]: WARNING nova.compute.manager [req-e29d89b0-f237-4692-b920-903194c4f5b5 req-8b0f6ab9-c4bc-48d8-8582-171a6866856d service nova] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Received unexpected event network-vif-plugged-1cbeb7a3-1ad5-4999-b7c2-cf9c0972b6d2 for instance with vm_state deleted and task_state None.
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:23 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Deleted allocations for instance 77065735-9358-4489-905f-f83e1a8f9869
Jul 26 17:29:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-674c0298-4434-4d12-956b-9c4d6383e3d7 tempest-TestServerVolumeAttachmentScenario-1663160358 tempest-TestServerVolumeAttachmentScenario-1663160358-project-member] Lock "77065735-9358-4489-905f-f83e1a8f9869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.641s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:26 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:26 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:29:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:29:28 user nova-compute[70594]: DEBUG nova.objects.instance [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lazy-loading 'info_cache' on Instance uuid b88832fc-c5af-4a5a-914b-f3028f1697a2 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:29:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:29:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:29:29 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:29:29 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:29 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:31 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:36 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392561.4506087, 77065735-9358-4489-905f-f83e1a8f9869 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:29:36 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 77065735-9358-4489-905f-f83e1a8f9869] VM Stopped (Lifecycle Event)
Jul 26 17:29:36 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8cb23678-f06d-46b1-bf32-bab68e9df4a0 None None] [instance: 77065735-9358-4489-905f-f83e1a8f9869] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:29:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-changed-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:37 user nova-compute[70594]: DEBUG nova.compute.manager [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Refreshing instance network info cache due to event network-changed-dd10f723-ad4a-4349-8447-212b3b7f1dc8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:29:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] Acquiring lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:29:37 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] Acquired lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:29:37 user nova-compute[70594]: DEBUG nova.network.neutron [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Refreshing network info cache for port dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updated VIF entry in instance network info cache for port dd10f723-ad4a-4349-8447-212b3b7f1dc8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG nova.network.neutron [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updating instance_info_cache with network_info: [{"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-e952758d-6554-4ecb-acfd-8d1ed4010710 req-45ce47d3-41e2-42ce-88cd-060162d322d4 service nova] Releasing lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:38 user nova-compute[70594]: INFO nova.compute.manager [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Terminating instance
Jul 26 17:29:38 user nova-compute[70594]: DEBUG nova.compute.manager [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:38 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-6f1cd1f9-73cb-49e3-b746-7486b210cf7b req-8d790556-a70d-42eb-92dd-31ce54639ecd service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-vif-unplugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6f1cd1f9-73cb-49e3-b746-7486b210cf7b req-8d790556-a70d-42eb-92dd-31ce54639ecd service nova] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6f1cd1f9-73cb-49e3-b746-7486b210cf7b req-8d790556-a70d-42eb-92dd-31ce54639ecd service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6f1cd1f9-73cb-49e3-b746-7486b210cf7b req-8d790556-a70d-42eb-92dd-31ce54639ecd service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-6f1cd1f9-73cb-49e3-b746-7486b210cf7b req-8d790556-a70d-42eb-92dd-31ce54639ecd service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] No waiting events found dispatching network-vif-unplugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-6f1cd1f9-73cb-49e3-b746-7486b210cf7b req-8d790556-a70d-42eb-92dd-31ce54639ecd service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-vif-unplugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-changed-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.compute.manager [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Refreshing instance network info cache due to event network-changed-dd10f723-ad4a-4349-8447-212b3b7f1dc8. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] Acquiring lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] Acquired lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Refreshing network info cache for port dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:29:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Instance destroyed successfully.
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.objects.instance [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'resources' on Instance uuid 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-419756781',display_name='tempest-TestVolumeBootPattern-server-419756781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-419756781',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:27:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-z0ln65ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:27:59Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_vif [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd10f723-ad, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:39 user nova-compute[70594]: INFO os_vif [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a6:70,bridge_name='br-int',has_traffic_filtering=True,id=dd10f723-ad4a-4349-8447-212b3b7f1dc8,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd10f723-ad')
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIRzxikm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:29:39 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9bec3f-9b13-47fd-bf53-0467fa3da3a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:29:39 user nova-compute[70594]: No targets found.
Jul 26 17:29:39 user nova-compute[70594]: iSNS:
Jul 26 17:29:39 user nova-compute[70594]: No targets found.
Jul 26 17:29:39 user nova-compute[70594]: STATIC:
Jul 26 17:29:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e
Jul 26 17:29:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:29:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:29:39 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:29:39 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:29:39 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:29:39 user nova-compute[70594]: FIRMWARE:
Jul 26 17:29:39 user nova-compute[70594]: No targets found.
Jul 26 17:29:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:29:39 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:29:39 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8200f6e0-2677-4ae2-8c59-4b3937e97445]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d1aea-0f84-46e9-9209-83632ce79800]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:29:39 user nova-compute[70594]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)
Jul 26 17:29:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:29:39 user nova-compute[70594]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e (non-flash)
Jul 26 17:29:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591830d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e'): ({'sdd'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Removing single pathed devices sdd {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[82209a50-fed7-490c-ae7e-431e1a8cf78d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad357b-6458-4941-80e9-59f0d462a9d5]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flushing IO for device /dev/sdd {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11278c-3892-4472-b835-1fb3e30751ac]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updated VIF entry in instance network info cache for port dd10f723-ad4a-4349-8447-212b3b7f1dc8. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.network.neutron [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updating instance_info_cache with network_info: [{"id": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "address": "fa:16:3e:97:a6:70", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd10f723-ad", "ovs_interfaceid": "dd10f723-ad4a-4349-8447-212b3b7f1dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-650e4cd4-e169-4b9d-a258-6d25d8886ae6 req-6b264859-61dd-4555-a368-5f24350deea9 service nova] Releasing lock "refresh_cache-15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e373d-a178-4ebf-9cf4-7f6eda9390ad]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] SCSI volumes sdd have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23661346663363030', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_73b79445', '/dev/disk/by-id/scsi-1SCST_BIO73b79445-6a4fc60039b11d61') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae336f2-c5ef-4011-a41a-b5afeddd5d01]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[735b4c53-0872-42bf-8b11-7043d0ddc25f]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f61392-a967-4179-b578-c1cd2c595701]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260]
Jul 26 17:29:39 user nova-compute[70594]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e, portal: 172.16.0.220,3260] successful.
Jul 26 17:29:39 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30f1e2d-2c51-4068-81ba-232d4c563f1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1333ec4a-bfd1-4153-b8f4-0d1f415d6b87]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== disconnect_volume: return (306ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:29:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Deleting instance files /opt/stack/data/nova/instances/15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c_del
Jul 26 17:29:39 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Deletion of /opt/stack/data/nova/instances/15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c_del complete
Jul 26 17:29:39 user nova-compute[70594]: INFO nova.compute.manager [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 26 17:29:39 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:29:39 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:29:40 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:29:40 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Took 0.50 seconds to deallocate network for instance.
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-6efc1e2f-5cca-42d6-a64a-81df7200947c req-22b14c8e-6693-4a93-bb3f-ac4cb34042e1 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6efc1e2f-5cca-42d6-a64a-81df7200947c req-22b14c8e-6693-4a93-bb3f-ac4cb34042e1 service nova] Acquiring lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6efc1e2f-5cca-42d6-a64a-81df7200947c req-22b14c8e-6693-4a93-bb3f-ac4cb34042e1 service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-6efc1e2f-5cca-42d6-a64a-81df7200947c req-22b14c8e-6693-4a93-bb3f-ac4cb34042e1 service nova] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-6efc1e2f-5cca-42d6-a64a-81df7200947c req-22b14c8e-6693-4a93-bb3f-ac4cb34042e1 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] No waiting events found dispatching network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:29:41 user nova-compute[70594]: WARNING nova.compute.manager [req-6efc1e2f-5cca-42d6-a64a-81df7200947c req-22b14c8e-6693-4a93-bb3f-ac4cb34042e1 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received unexpected event network-vif-plugged-dd10f723-ad4a-4349-8447-212b3b7f1dc8 for instance with vm_state active and task_state deleting.
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.manager [req-67c1e701-dcff-490d-9a1d-96e73c30a35c req-0dab6376-99b5-45ea-af61-5717750d8cd5 service nova] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Received event network-vif-deleted-dd10f723-ad4a-4349-8447-212b3b7f1dc8 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:29:41 user nova-compute[70594]: INFO nova.compute.manager [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Took 0.89 seconds to detach 1 volumes for instance.
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Refreshing inventories for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Updating ProviderTree inventory for provider e707ce86-5823-47be-ae04-864d58aeb2e9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Updating inventory in ProviderTree for provider e707ce86-5823-47be-ae04-864d58aeb2e9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Refreshing aggregate associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, aggregates: None {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Refreshing trait associations for resource provider e707ce86-5823-47be-ae04-864d58aeb2e9, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI {{(pid=70594) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:41 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Deleted allocations for instance 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-1ffc7315-cf3e-437e-8934-8025cd3c30ad tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] There are 0 instances to clean {{(pid=70594) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 26 17:29:41 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:46 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:29:46 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70594) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 26 17:29:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:29:54 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392579.5138848, 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:29:54 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] VM Stopped (Lifecycle Event)
Jul 26 17:29:54 user nova-compute[70594]: DEBUG nova.compute.manager [None req-396ff60a-1643-4466-bd57-b987890934ca None None] [instance: 15eaed08-8ddc-4c4b-91c1-f490e6d3cc1c] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:29:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:29:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-changed-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG nova.compute.manager [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Refreshing instance network info cache due to event network-changed-41d36c7c-01ae-4976-be25-401bcd88c55a. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] Acquiring lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] Acquired lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Refreshing network info cache for port 41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updated VIF entry in instance network info cache for port 41d36c7c-01ae-4976-be25-401bcd88c55a. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG nova.network.neutron [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updating instance_info_cache with network_info: [{"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:30:03 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-f2151c8d-b0a8-4266-97f2-e4ca93f6db7a req-728905f0-61b5-41b6-bbd4-3a62b924eb92 service nova] Releasing lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:30:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:04 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'flavor' on Instance uuid 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:30:04 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Ignoring supplied device name: /dev/vdb
Jul 26 17:30:04 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:05 user nova-compute[70594]: INFO nova.compute.manager [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Attaching volume 873931f0-a50a-4a30-833b-55f23a39c129 to /dev/vdb
Jul 26 17:30:05 user nova-compute[70594]: DEBUG os_brick.utils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b99b97-02f2-420e-a856-55687e333622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:991aa424bfdf\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e2354-3e3b-42e0-b17b-bf54d1dc5ea4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f35def-6ef0-4725-b6ba-0c9d68daa6f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a95cf6f-4cac-4495-b58b-5c92d7a9d2e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Running cmd (subprocess): nvme version {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] 'nvme version' failed. Not Retrying. {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] nvme not present on system {{(pid=70594) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 26 17:30:05 user nova-compute[70594]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 26 17:30:05 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91001d-f001-4481-a0eb-7951d02e6fcd]: (4, '') {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70594) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] LIGHTOS: no hostnqn found. {{(pid=70594) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG os_brick.utils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:991aa424bfdf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:30:05 user nova-compute[70594]: DEBUG nova.virt.block_device [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updating existing volume attachment record: e8d2d6c3-b4d8-48a7-a2ec-537fa7a6a940 {{(pid=70594) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 26 17:30:06 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:11 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Calling os-brick to attach iSCSI Volume {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZASPJsfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:30:15 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:30:15 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:30:15 user nova-compute[70594]: INFO os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e1a06-ad82-4c91-ba90-b938df1b192b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 26 17:30:15 user nova-compute[70594]:  {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --interface default --op new {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b7c03-89a4-484b-ae23-c6d47542d322]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129] added\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129] added
Jul 26 17:30:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[534825e5-64a0-4449-a9bf-03087c662919]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459ab43-b67d-40fc-a740-63f2875ca3d7]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZASPJsfV {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZASPJsfV" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbeb099-e79f-41c9-978e-3ce0ae0fa1cd]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZASPJsfV'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bc0ab9-a01d-4427-b076-709524c8daf8]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[76254796-eb64-4c5f-bde6-d33fe1467a1f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --login {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8a870c-d72f-41f4-a115-d32e1da5675d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260]
Jul 26 17:30:15 user nova-compute[70594]: Login to [iface: default, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260] successful.
Jul 26 17:30:15 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:15 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed23f12-b92a-454a-a40a-510411684645]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29dfccb-c072-4afb-bb21-50722b4a8cb4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:16 user nova-compute[70594]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 (non-flash)
Jul 26 17:30:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:16 user nova-compute[70594]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 (non-flash)
Jul 26 17:30:16 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Connected to 172.16.0.220:3260 {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=70594) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70594) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0879fc2-42f9-47f3-8a40-be46a7f1d3f1]: (4, ('- - 0', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70594) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 26 17:30:16 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZASPJsfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70594) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23035303766323235', 'path': '/dev/sdc'} {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035303766323235', 'path': '/dev/sdc'} {{(pid=70594) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'flavor' on Instance uuid 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] attach device xml: <disk type="block" device="disk">
Jul 26 17:30:17 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:30:17 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:30:17 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:30:17 user nova-compute[70594]:   <serial>873931f0-a50a-4a30-833b-55f23a39c129</serial>
Jul 26 17:30:17 user nova-compute[70594]: </disk>
Jul 26 17:30:17 user nova-compute[70594]:  {{(pid=70594) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70594) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] No VIF found with MAC fa:16:3e:43:2c:54, not building metadata {{(pid=70594) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 26 17:30:17 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9ec3c9b9-15c9-4b40-9eec-243cab9397ac tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.567s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:21 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:22 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:22 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:22 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:30:22 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70594) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70594) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 26 17:30:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:30:23 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=25.25381088256836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance b88832fc-c5af-4a5a-914b-f3028f1697a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70594) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1669}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:30:23 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:30:24 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:30:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:25 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquired lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:30:28 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Forcefully refreshing network info cache for instance {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 26 17:30:29 user nova-compute[70594]: DEBUG nova.network.neutron [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updating instance_info_cache with network_info: [{"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:30:29 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Releasing lock "refresh_cache-3fc57686-9a41-42a9-ba9e-331eac88a3fa" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:30:29 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updated the network info_cache for instance {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 26 17:30:29 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:30 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:31 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:32 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:30:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:36 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:41 user nova-compute[70594]: INFO nova.compute.manager [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Detaching volume 873931f0-a50a-4a30-833b-55f23a39c129
Jul 26 17:30:41 user nova-compute[70594]: INFO nova.virt.block_device [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Attempting to driver detach volume 873931f0-a50a-4a30-833b-55f23a39c129 from mountpoint /dev/vdb
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Attempting to detach device vdb from instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa from the persistent domain config. {{(pid=70594) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:30:41 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:30:41 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:30:41 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:30:41 user nova-compute[70594]:   <serial>873931f0-a50a-4a30-833b-55f23a39c129</serial>
Jul 26 17:30:41 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:30:41 user nova-compute[70594]: </disk>
Jul 26 17:30:41 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:30:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully detached device vdb from instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa from the persistent domain config.
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa from the live domain config. {{(pid=70594) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.guest [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] detach device xml: <disk type="block" device="disk">
Jul 26 17:30:41 user nova-compute[70594]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 26 17:30:41 user nova-compute[70594]:   <source dev="/dev/sdc"/>
Jul 26 17:30:41 user nova-compute[70594]:   <target dev="vdb" bus="virtio"/>
Jul 26 17:30:41 user nova-compute[70594]:   <serial>873931f0-a50a-4a30-833b-55f23a39c129</serial>
Jul 26 17:30:41 user nova-compute[70594]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 26 17:30:41 user nova-compute[70594]: </disk>
Jul 26 17:30:41 user nova-compute[70594]:  {{(pid=70594) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-820af05f-3f6c-4394-93fe-f6cf4abfdf4d None None] Received event <DeviceRemovedEvent: 1690392641.5586548, 3fc57686-9a41-42a9-ba9e-331eac88a3fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70594) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.driver [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 26 17:30:41 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully detached device vdb from instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa from the live domain config.
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZASPJsfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:30:41 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e8e671-75b0-4d8c-a5b9-da9e1fcaa298]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:30:41 user nova-compute[70594]: No targets found.
Jul 26 17:30:41 user nova-compute[70594]: iSNS:
Jul 26 17:30:41 user nova-compute[70594]: No targets found.
Jul 26 17:30:41 user nova-compute[70594]: STATIC:
Jul 26 17:30:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129
Jul 26 17:30:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:30:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:30:41 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:30:41 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:30:41 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:30:41 user nova-compute[70594]: FIRMWARE:
Jul 26 17:30:41 user nova-compute[70594]: No targets found.
Jul 26 17:30:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:30:41 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:30:41 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f36ba7f-10d3-4c2d-8127-f699ff7555bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c40a731-063c-4d4f-96f3-05586252d378]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:41 user nova-compute[70594]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 (non-flash)
Jul 26 17:30:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:41 user nova-compute[70594]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 (non-flash)
Jul 26 17:30:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f591b8076d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129'): ({'sdc'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Removing single pathed devices sdc {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[64345ddf-45e6-4595-a6dd-dbffe27295f0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda18bab-4dff-4b51-92d4-458d24356a68]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Flushing IO for device /dev/sdc {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de11b4-44c2-4cdb-ac74-4f3c4b2d752a]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7989b3c1-b979-4ba1-90e5-c442ff3b1932]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] SCSI volumes sdc have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaafe3f-b920-490d-a9f1-d34e1a89f8fa]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cdc9dc-b4b0-4dc2-bdc9-65221637452b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260]
Jul 26 17:30:41 user nova-compute[70594]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129, portal: 172.16.0.220,3260] successful.
Jul 26 17:30:41 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a612fb-8bf3-4307-9366-a2e267c982dc]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== disconnect_volume: return (313ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:30:41 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG nova.objects.instance [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'flavor' on Instance uuid 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-8110a3bd-89b9-4f8a-8561-d17b6a8cb5b6 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.566s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:42 user nova-compute[70594]: INFO nova.compute.manager [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Terminating instance
Jul 26 17:30:42 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-710677e9-a778-401a-bfcb-2080dc335d4f req-de480ff7-772f-4745-ab6a-7355b3d472c5 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-vif-unplugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-710677e9-a778-401a-bfcb-2080dc335d4f req-de480ff7-772f-4745-ab6a-7355b3d472c5 service nova] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-710677e9-a778-401a-bfcb-2080dc335d4f req-de480ff7-772f-4745-ab6a-7355b3d472c5 service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-710677e9-a778-401a-bfcb-2080dc335d4f req-de480ff7-772f-4745-ab6a-7355b3d472c5 service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-710677e9-a778-401a-bfcb-2080dc335d4f req-de480ff7-772f-4745-ab6a-7355b3d472c5 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] No waiting events found dispatching network-vif-unplugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-710677e9-a778-401a-bfcb-2080dc335d4f req-de480ff7-772f-4745-ab6a-7355b3d472c5 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-vif-unplugged-41d36c7c-01ae-4976-be25-401bcd88c55a for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:30:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Instance destroyed successfully.
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lazy-loading 'resources' on Instance uuid 3fc57686-9a41-42a9-ba9e-331eac88a3fa {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:28:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-362998791',display_name='tempest-VolumesSnapshotTestJSON-instance-362998791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-362998791',id=51,image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLo9hJ3j51wTX+LNJZGCUuNDG0Q60EDSdXoFJWp85cxXZvh77iZhsKs0AympdUbxMwIlldDTaAbbR5lGIGJ7C7D+JXq7TgKJNCALce9wMBoEGpb8+lWQUzoaKMSaEXc6g==',key_name='tempest-keypair-1361925694',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:28:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee3473a9917a4c8db792409b139e8262',ramdisk_id='',reservation_id='r-0sd6eb0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb0188fe-f507-4fcc-b390-0fd03c1cea08',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-953872237',owner_user_name='tempest-VolumesSnapshotTestJSON-953872237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceac1fcf58744384b3960b8c736ece77',uuid=3fc57686-9a41-42a9-ba9e-331eac88a3fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converting VIF {"id": "41d36c7c-01ae-4976-be25-401bcd88c55a", "address": "fa:16:3e:43:2c:54", "network": {"id": "bc816ba4-254e-49d7-bcc8-ece51aae084e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1063545213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3473a9917a4c8db792409b139e8262", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d36c7c-01", "ovs_interfaceid": "41d36c7c-01ae-4976-be25-401bcd88c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_vif [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d36c7c-01, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: INFO os_vif [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:2c:54,bridge_name='br-int',has_traffic_filtering=True,id=41d36c7c-01ae-4976-be25-401bcd88c55a,network=Network(bc816ba4-254e-49d7-bcc8-ece51aae084e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d36c7c-01')
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZASPJsfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:30:43 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb776e1-7eb8-48e9-944f-7f77c2517f59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:30:43 user nova-compute[70594]: No targets found.
Jul 26 17:30:43 user nova-compute[70594]: iSNS:
Jul 26 17:30:43 user nova-compute[70594]: No targets found.
Jul 26 17:30:43 user nova-compute[70594]: STATIC:
Jul 26 17:30:43 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:30:43 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:30:43 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:30:43 user nova-compute[70594]: FIRMWARE:
Jul 26 17:30:43 user nova-compute[70594]: No targets found.
Jul 26 17:30:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:30:43 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:30:43 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873931f0-a50a-4a30-833b-55f23a39c129', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da8960-7b2f-4849-95f8-3e6b31023661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e80b20-adee-436e-9c01-15b638ae3446]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:43 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f590050ef80>, {}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Disconnecting from: [] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] <== disconnect_volume: return (71ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:30:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Deleting instance files /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa_del
Jul 26 17:30:43 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Deletion of /opt/stack/data/nova/instances/3fc57686-9a41-42a9-ba9e-331eac88a3fa_del complete
Jul 26 17:30:43 user nova-compute[70594]: INFO nova.compute.manager [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-changed-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Refreshing instance network info cache due to event network-changed-e25d14b4-d60a-4ccb-a302-97b925d036d6. {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] Acquiring lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] Acquired lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.network.neutron [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Refreshing network info cache for port e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 26 17:30:43 user nova-compute[70594]: INFO nova.compute.manager [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Terminating instance
Jul 26 17:30:43 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Start destroying the instance on the hypervisor. {{(pid=70594) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:43 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c37bf50-6ab9-4b5f-8e71-f3743ace825b req-f176f3b9-ef12-4241-8533-7f2f28766934 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-vif-unplugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c37bf50-6ab9-4b5f-8e71-f3743ace825b req-f176f3b9-ef12-4241-8533-7f2f28766934 service nova] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c37bf50-6ab9-4b5f-8e71-f3743ace825b req-f176f3b9-ef12-4241-8533-7f2f28766934 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-3c37bf50-6ab9-4b5f-8e71-f3743ace825b req-f176f3b9-ef12-4241-8533-7f2f28766934 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c37bf50-6ab9-4b5f-8e71-f3743ace825b req-f176f3b9-ef12-4241-8533-7f2f28766934 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] No waiting events found dispatching network-vif-unplugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.compute.manager [req-3c37bf50-6ab9-4b5f-8e71-f3743ace825b req-f176f3b9-ef12-4241-8533-7f2f28766934 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-vif-unplugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 for instance with task_state deleting. {{(pid=70594) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 26 17:30:44 user nova-compute[70594]: INFO nova.virt.libvirt.driver [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Instance destroyed successfully.
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.objects.instance [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lazy-loading 'resources' on Instance uuid b88832fc-c5af-4a5a-914b-f3028f1697a2 {{(pid=70594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.vif [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-26T17:25:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1574471287',display_name='tempest-TestVolumeBootPattern-server-1574471287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1574471287',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGZk5Vh10bi4GNXjOOfH9+1hD2izvH9b9ToL/fYcLjsk2hhBVgHRH4UcBnCeBD4dvFFCeAZGhNdxgZvniFDdzAfue8+iAZtPOu88GUBPP1ZF/3izOwNAmMY8icRsjpcog==',key_name='tempest-TestVolumeBootPattern-853461131',keypairs=<?>,launch_index=0,launched_at=2023-07-26T17:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f39be2f463416faaeae34d088bb57c',ramdisk_id='',reservation_id='r-2olmm36o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-491432484',owner_user_name='tempest-TestVolumeBootPattern-491432484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-26T17:25:47Z,user_data=None,user_id='68fd221b17924ce3b9770c36fbbb52df',uuid=b88832fc-c5af-4a5a-914b-f3028f1697a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converting VIF {"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.network.os_vif_util [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6') {{(pid=70594) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_vif [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6') {{(pid=70594) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape25d14b4-d6, bridge=br-int, if_exists=True) {{(pid=70594) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:30:44 user nova-compute[70594]: INFO os_vif [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d7:b0,bridge_name='br-int',has_traffic_filtering=True,id=e25d14b4-d60a-4ccb-a302-97b925d036d6,network=Network(c433dc5d-79b7-4816-946c-4450bbcd8e27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d14b4-d6')
Jul 26 17:30:44 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] calling os-brick to detach iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59103902e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaAsoOUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 26 17:30:44 user nova-compute[70594]: WARNING os_brick.initiator.connectors.base [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bb667c-14f9-459b-a852-82f638c9afa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 26 17:30:44 user nova-compute[70594]: No targets found.
Jul 26 17:30:44 user nova-compute[70594]: iSNS:
Jul 26 17:30:44 user nova-compute[70594]: No targets found.
Jul 26 17:30:44 user nova-compute[70594]: STATIC:
Jul 26 17:30:44 user nova-compute[70594]: Target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673
Jul 26 17:30:44 user nova-compute[70594]:         Portal: 172.16.0.220:3260,-1
Jul 26 17:30:44 user nova-compute[70594]:                 Iface Name: default
Jul 26 17:30:44 user nova-compute[70594]: FIRMWARE:
Jul 26 17:30:44 user nova-compute[70594]: No targets found.
Jul 26 17:30:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 26 17:30:44 user nova-compute[70594]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 26 17:30:44 user nova-compute[70594]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70594) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673', 0)] {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a02f7-5c9d-4a20-95d0-f4e85aa7dcd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54456e39-967b-4bd8-9e4b-253525d10c5c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 (non-flash)
Jul 26 17:30:44 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59106c57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673'): ({'sdb'}, set())}) {{(pid=70594) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Removing single pathed devices sdb {{(pid=70594) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac49fef-c5f9-45be-a954-fed52397e375]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69911c5-2c03-4b8e-90f2-fecbeda31519]: (4, ('ok\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Flushing IO for device /dev/sdb {{(pid=70594) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cfebd4-c57c-4321-a6c1-551d4e187c9e]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70594) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.121s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3020993e-2cf4-4d7e-a01e-431d7e3a6b62]: (4, ('1', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.linuxscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] SCSI volumes sdb have been removed. {{(pid=70594) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26436303863626162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f934f825', '/dev/disk/by-id/scsi-1SCST_BIOf934f825-d608cbab7e53b355') {{(pid=82207) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef3fc7-7960-4696-950d-c86aa9649620]: (4, None) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673')] {{(pid=70594) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a332711b-e22e-4325-adbd-c95ee078c9cd]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:44 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --logout {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737f3ff-816a-4f66-b569-5a1bf9eb0096]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260]
Jul 26 17:30:45 user nova-compute[70594]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673, portal: 172.16.0.220,3260] successful.
Jul 26 17:30:45 user nova-compute[70594]:  stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op delete {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf6fff1-8602-40ee-9cc1-ffe4f9591673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82207) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cda37b-caa9-4a99-9f73-724ce8cd5545]: (4, ('', '')) {{(pid=82207) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70594) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.base [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] <== disconnect_volume: return (434ms) None {{(pid=70594) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Disconnected iSCSI Volume {{(pid=70594) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Deleting instance files /opt/stack/data/nova/instances/b88832fc-c5af-4a5a-914b-f3028f1697a2_del
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.virt.libvirt.driver [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Deletion of /opt/stack/data/nova/instances/b88832fc-c5af-4a5a-914b-f3028f1697a2_del complete
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.compute.manager [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo.service.loopingcall [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70594) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.compute.manager [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Deallocating network for instance {{(pid=70594) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] deallocate_for_instance() {{(pid=70594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.network.neutron [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updated VIF entry in instance network info cache for port e25d14b4-d60a-4ccb-a302-97b925d036d6. {{(pid=70594) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.network.neutron [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [{"id": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "address": "fa:16:3e:47:d7:b0", "network": {"id": "c433dc5d-79b7-4816-946c-4450bbcd8e27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-682836870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f39be2f463416faaeae34d088bb57c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d14b4-d6", "ovs_interfaceid": "e25d14b4-d60a-4ccb-a302-97b925d036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-34f3687f-f0fa-42c4-a243-8bd9aa4153b3 req-e6beb241-9bf1-4222-a7a1-9e18e528b9dd service nova] Releasing lock "refresh_cache-b88832fc-c5af-4a5a-914b-f3028f1697a2" {{(pid=70594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c7c8cea-b6cc-45db-aff2-9246cbf6b6d0 req-74fbef38-86f5-44c9-bbb6-e66a7a2459a4 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c7c8cea-b6cc-45db-aff2-9246cbf6b6d0 req-74fbef38-86f5-44c9-bbb6-e66a7a2459a4 service nova] Acquiring lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c7c8cea-b6cc-45db-aff2-9246cbf6b6d0 req-74fbef38-86f5-44c9-bbb6-e66a7a2459a4 service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-2c7c8cea-b6cc-45db-aff2-9246cbf6b6d0 req-74fbef38-86f5-44c9-bbb6-e66a7a2459a4 service nova] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.compute.manager [req-2c7c8cea-b6cc-45db-aff2-9246cbf6b6d0 req-74fbef38-86f5-44c9-bbb6-e66a7a2459a4 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] No waiting events found dispatching network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:30:45 user nova-compute[70594]: WARNING nova.compute.manager [req-2c7c8cea-b6cc-45db-aff2-9246cbf6b6d0 req-74fbef38-86f5-44c9-bbb6-e66a7a2459a4 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received unexpected event network-vif-plugged-41d36c7c-01ae-4976-be25-401bcd88c55a for instance with vm_state active and task_state deleting.
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Took 1.92 seconds to deallocate network for instance.
Jul 26 17:30:45 user nova-compute[70594]: WARNING nova.volume.cinder [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Attachment e8d2d6c3-b4d8-48a7-a2ec-537fa7a6a940 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e8d2d6c3-b4d8-48a7-a2ec-537fa7a6a940. (HTTP 404) (Request-ID: req-5d45b88c-ef6b-4efd-9ba2-4917a244d766)
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.compute.manager [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Took 0.03 seconds to detach 1 volumes for instance.
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.network.neutron [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Updating instance_info_cache with network_info: [] {{(pid=70594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 26 17:30:45 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Took 0.63 seconds to deallocate network for instance.
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:45 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Deleted allocations for instance 3fc57686-9a41-42a9-ba9e-331eac88a3fa
Jul 26 17:30:45 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9de091ff-2814-4a49-810e-21bfcbc51e19 tempest-VolumesSnapshotTestJSON-953872237 tempest-VolumesSnapshotTestJSON-953872237-project-member] Lock "3fc57686-9a41-42a9-ba9e-331eac88a3fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] Acquiring lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:46 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] No waiting events found dispatching network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 26 17:30:46 user nova-compute[70594]: WARNING nova.compute.manager [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received unexpected event network-vif-plugged-e25d14b4-d60a-4ccb-a302-97b925d036d6 for instance with vm_state active and task_state deleting.
Jul 26 17:30:46 user nova-compute[70594]: DEBUG nova.compute.manager [req-194049f8-a54b-4011-9390-5fb71812abea req-3af29b2f-d592-4a63-861e-9491b27fcc02 service nova] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Received event network-vif-deleted-41d36c7c-01ae-4976-be25-401bcd88c55a {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:47 user nova-compute[70594]: DEBUG nova.compute.manager [req-c6db8f22-f257-4890-adc7-6cfb8ca158e8 req-62345b8d-02f8-4a00-b48c-880233bec53c service nova] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Received event network-vif-deleted-e25d14b4-d60a-4ccb-a302-97b925d036d6 {{(pid=70594) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 26 17:30:48 user nova-compute[70594]: INFO nova.compute.manager [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Took 2.81 seconds to detach 1 volumes for instance.
Jul 26 17:30:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:30:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:30:48 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:30:48 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:30:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:48 user nova-compute[70594]: INFO nova.scheduler.client.report [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Deleted allocations for instance b88832fc-c5af-4a5a-914b-f3028f1697a2
Jul 26 17:30:48 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-9dc21a95-71e7-4035-8b52-852d4066969d tempest-TestVolumeBootPattern-491432484 tempest-TestVolumeBootPattern-491432484-project-member] Lock "b88832fc-c5af-4a5a-914b-f3028f1697a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.091s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:30:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:30:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70594) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 26 17:30:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:30:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70594) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 26 17:30:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:58 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392643.4477801, 3fc57686-9a41-42a9-ba9e-331eac88a3fa => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:30:58 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] VM Stopped (Lifecycle Event)
Jul 26 17:30:58 user nova-compute[70594]: DEBUG nova.compute.manager [None req-9c0f1ebe-b373-4827-b6ba-f909b2002bcd None None] [instance: 3fc57686-9a41-42a9-ba9e-331eac88a3fa] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:30:59 user nova-compute[70594]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690392644.5554438, b88832fc-c5af-4a5a-914b-f3028f1697a2 => Stopped> {{(pid=70594) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 26 17:30:59 user nova-compute[70594]: INFO nova.compute.manager [-] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] VM Stopped (Lifecycle Event)
Jul 26 17:30:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:30:59 user nova-compute[70594]: DEBUG nova.compute.manager [None req-8c7585d1-12ff-4609-8620-4edf1a7459f5 None None] [instance: b88832fc-c5af-4a5a-914b-f3028f1697a2] Checking state {{(pid=70594) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 26 17:31:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:19 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:23 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:24 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:31:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:31:24 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:31:24 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:31:25 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:31:25 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:31:25 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=25.279014587402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:31:25 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:31:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:27 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:31:27 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:31:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:31:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 17:31:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:30 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:30 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:31 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:31:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:31:42 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:46 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:31:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 26 17:32:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:09 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:14 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:19 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:20 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:24 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:26 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:32:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:32:26 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:32:26 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Auditing locally available compute resources for user (node: user) {{(pid=70594) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:898}}
Jul 26 17:32:27 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:32:27 user nova-compute[70594]: WARNING nova.virt.libvirt.driver [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 26 17:32:27 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=25.2762451171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70594) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1071}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1094}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70594) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG nova.compute.provider_tree [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed in ProviderTree for provider: e707ce86-5823-47be-ae04-864d58aeb2e9 {{(pid=70594) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG nova.scheduler.client.report [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Inventory has not changed for provider e707ce86-5823-47be-ae04-864d58aeb2e9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70594) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG nova.compute.resource_tracker [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Compute_service record updated for user:user {{(pid=70594) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1032}}
Jul 26 17:32:27 user nova-compute[70594]: DEBUG oslo_concurrency.lockutils [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=70594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 26 17:32:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:28 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70594) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 26 17:32:28 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:29 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:29 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:29 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Starting heal instance info cache {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 26 17:32:29 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Rebuilding the list of instances to heal {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 26 17:32:29 user nova-compute[70594]: DEBUG nova.compute.manager [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Didn't find any instances for network info cache update. {{(pid=70594) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 26 17:32:31 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:31 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:32 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:34 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:35 user nova-compute[70594]: DEBUG oslo_service.periodic_task [None req-3c6bd4e9-365d-4064-9909-235c05ef3c47 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70594) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 26 17:32:39 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:44 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:49 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:54 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:32:59 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 26 17:33:04 user nova-compute[70594]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70594) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}